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(54) A NETWORK CONTROL SYSTEM 

(57) An object of the present invention is to provide 
a network control system capable of flexibly construct- 
ing an operational environment suitable for each func- 
tion and equipment in a simple configuration with a fight 
load on a transmission line and each equipment and 
readily adapting to a new function not conceivable at 
present. To attain the above object, a network control 
system according to the present invention controls at 
least one piece of equipment from another piece of 
equipment through a transmission line in a system in 
which a plurality of equipment interconnected over the 



transmission line. The network control system com- 
prises a controller having a user interface and a device 
having a function list (8) indicating functions thereof as 
constituents In any equipment connected to the trans- 
mission line. The device transmits the function list (8) 
through the transmission line (1). The controller notifies 
information about the device to a user with using the 
received function Ost (8), and controls the device with 
utilizing the function list (8) in accordance with a user's 
operation. 
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Description 

TECHNICAL FIELD 

[0001] The present Invention relates to network con- 
trol systems for operating over networta equipment 
interconnected on the networks, and more specifically 
loan equipment control system providing on a screen a 
graphical user Interlace (QUI) for supporting user's 
operation of equipment by means of graphics, charac- 
ters and the like. 

BACKGROUND ART 

[0002] In recent years, an equipment control system 
which displays on a TV screen graphics (icon) compris- 
ing of screen display data, characters and the like for 
representing the functions of equipment and controls 
the equipment based on users operation of selecting 
and manipulating the graphics with a TV remote control- 
ler has been introduced. Moreover, a networked system 
interconnecting digital equipment such as DVC (digital 
video cassette) therein using the IEEE standard 1394- 
1 995 to transmit and receive video/audio data is also in 
use. 

[0003] One of conventional network control systems is 
disclosed in Japanese Patent Laying-Open No. 9- 
149325. 

[0004] An example of the conventional network control 
systems is descrbed below. 

[0005] AV equipment is connected with another AV 
equipment on a serial bus, such as a digital interface, for 
example, the IEEE standard 1394 and the like, over 
which the AV equipment is provided with equal commu- 
nication opportunities at periodic time intervals in two- 
way packet communication mode without switching con- 
nection therebetweea 

[0006] Here, each AV equipment contains peculiar 
screen display data therein, to transmit the screen dis- 
play data to a controller (for example, a television set) 
having the function of displaying graphics in response to 
a request from the controller. The controller then dis- 
plays the screen display data. 
[0007] Besides, the controller has also the functions of 
making Inquiries about the data required for displaying 
the AV equipment connected thereto, and controlling 
display on a screen generated based on the screen dis- 
play data suppGed from the AV equipment. 
[0008] Each AV equipment has a storage mecfium 
storing the screen display data thereon, and the func- 
tion of selecting appropriate screen display data in 
response to the inquiry about screen display data from 
the controller, 

[0009] In the network control system configured as 
above, the screen display data is saved In each device 
(AV equipment), and outputted in response to the dis- 
play request from the controller (television set). The 
graphics peculiar to each device (AV equipment) is thus 



displayed on the screen of the controDer. 
[0010] In the network control system with the above 
configuration, however, when the screen display data is 
required, for example, when the displayed graphics, for 

5 representing the device, such as an icon is changed by 
user's operation, the controller must inquire the screen 
display data about the device through a transmission 
line. This leads to a problem that the traffic on the trans- 
mission line increases and much time is spent for dis- 

w playing the data. 

[0011] Moreover, the network control system has 
another problem that the device Is required to have the 
function of selecting appropriate screen display data in 
response to the inquiry from the controller, which results 

75 in heavy processing load on the device. 

[001 2] Furthermore, the network control system has a 
further problem that the screen display data is peculiar 
to each AV equipment and therefore has Gttle flexibility 
In display on the controller. 

20 [0013] ~TTie present invention solves the above- 
described problems. That is, an object of the present 
invention is to provide a network control system capable 
of flexibly constructing an operational environment suit- 
able for each function and equipment in a simple config- 

29 uraticn with a light load on a transmission line and each 
equipment and readily adapting to even a new function 
not conceivable at present and further to equipment 
having a plurality of devices. 



[0014] A first aspect of the present invention is 
directed to a network control system in which a plurality 
of equipment are connected through a transmission 
ss line, and first equipment controls second equipment 
through the transmission line, wherein 

at least one of the first and second equipment han- 
dles at least one of video, audio and information, 
40 the first equipment includes a controller having a 
user interface, 

the second equipment includes a device to be con- 
trolled by the controller, 

the device has function information indicating time- 
rs tions of the device itself, and 

the controller acquires the function information from 
the device through the transmission line, and con- 
trols the device through the transmission line 
through the use of the function information acocrd- 
50 Ing to a user's operation performed by means of the 
user interface. 

[0015] According to the first aspect of the present 
invention, provided are a controller having a user inter- 
55 face, a device having function information indicating its 
own functions. The device transmits the function infor- 
mation to the controller through a transmission One, and 
the controller notifies information about the device to a 
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user through the use of the function information and 
controls the device according to the user's operation, 
whereby a user-friendly operational environment can be 
realized in a simple configuration and it is possfole to 
readily adapt to a device having a new function not con- 5 
ceivabie at present 

[0016] A second aspect Is directed to second equip- 
ment, connected to first equipment including a controller 
through a transmission line, including a device to be 
controlled by the controller through the transmission 

line, 

at least one of the first and second equipment han- 
dling at least one of video, audio and Information, 
and 

wherein the device 

has function information indicating functions of the 
device, 

sends the function Information to the transmission 
line in response to a request from the controller, 
and 

operates in accordance with control performed by 
the controller on a basis of the function information 
to realize the functions of the device. 

[0017] The equipment according to the second aspect 
of the present invention can be used as second equip- 
ment including the device to be controlled in the network 
control system according to the first aspect of the 
present invention. 

[0018] A third aspect of the present invention is 
directed to first equipment, connected to second equip- 
ment through a transmission line, including a controller 
controlling a device included in the second equipment 
through the transmission line, 

at least one of the first and second equipment han- 
dling at least one of video, audio, and Information, 
and 

wherein the controller 
comprises a user interface, 
acquires function information indicating functions of 
the device from the device through the transmission 
line, and 

controls the device through the transmission line 
through the use of the function information accord- 
ing to a user's operation performed by means of the 
user interface. 

[001 9] The equipment according to the third aspect of 
the present invention can be used as first equipment 
including the controDer in the network control system 
according to the first aspect of the present invention. 
[0020] According to a fourth aspect of the present 
invention, In the first aspect of the present invention, 

the function Information has a layer structure, and 
includes a device information layer composed of 



attribute information including identification infor- 
mation of the device, and function information layer 
indicating the functions of the device. 

[0021 ] According to the fourth aspect of the present 
invention, a device information layer composed of 
attribute information including identification Information 
of the device, and function information layer indicating 
the functions of the device are provided in the function 
information. Therefore, It is possible to optimize both an 
operational environment for each device and an opera- 
tional environment for each function of the device, and 
rea&ze a user-friendly operational environment. 
[0022] According to a fifth aspect of the present inven- 
tion, in the first aspect of the present invention, 

the device includes a plurality of sub-devices, and 
the function information has a layer structure, and 
Includes a device information layer composed of 
attribute information including identification infor- 
mation of the device, a sub-device Information layer 
composed of attribute information including Identifi- 
cation information of the sub-devices, and function 
information layer indicating the functions of the sub- 
device. 

[0023] According to the fifth aspect of the present 
invention, a device information layer indicating informa- 
tion about the device, a sub-device information layer 
indicating information about the sub-devices in the 
device, and a function information layer indicating the 
functions of the sub-devices are provided. Conse- 
quently, appropriate operational environment can be 
provided for each sub-device in each device, and the 
device can be controlled from different controllers for 
each sub-device. 

[0024] According to a sixth aspect of the present 
invention, in the first aspect of the present invention, 

the function information includes user interface 
information. 

[0025] According to a seventh aspect of the present 
invention, in the fourth or fifth aspect of the present 
invention, 

the function information includes a device GUI layer 
composed of user interface information of the 
device identified with the attribute information in the 
device information layer. 

[0026] According to an eighth aspect of the present 
invention, in the fourth or fifth aspect of the present 
invention, 

the function information includes a function GUI 
layer composed of user Interface information of the 
functions in the function information layer. 
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[0027] According to a ninth aspect of the present 
invention, in the ffith aspect of the present invention, 

the function information has a sub-device GUI layer 
composed of user interface Information of sub- 
devices identff ied with the attribute information in 
the sub-device Information layer. 

[0028] According to the seventh, eighth, ninth aspects 
of the present invention, a device QUI layer, function 
GUI layer, and sub-device GUI layer describing user 
Interface information of the device Indicated in a device 
information layer, a function information layer, and sub- 
device are included. This makes it possible to construct 
a flexible user interface for each hierarchy and realize 
an optimal operational environment for each device, 
function, and sub-device. 

[0029] According to a tenth aspect of the present 
invention, in the fourth or fifth aspect of the present 
invention, an identifier is provided for each of the func- 
tions In the function information layer. 
[0030] According to the tenth aspect of the present 
invention, an identifier is provided for each function 
described in the function information layer, and thereby 
making identification and retrieval of the functions eas- 
ier when managing/consulting function information with 
the controller. 

[0031 ] According to an eleventh aspect of the present 
invention, in the seventh, eighth or ninth aspect of the 
present invention, 

information in the device GUI layer, the function 
GUI layer or the sub-device GUI layer is classified 
according to user's operation and a status of the 
device. 

[0032] According to the eleventh aspect, the device 
GUI layer, the function GUI layer or the sub-device GUI 
layer is classified according to user's operation and a 
status of the device. Therefore, a user-friendly and 
easy-to-understand operational environment can be 
readily constructed. 

[0033] According to a twelfth aspect of the present 
invention, in the first aspect of the present invention, 

the function information includes a control code cor- 
responding to each of the functions which the 
device has, and 

when the controller transmits the control code 
included in the function information to the device 
through the transmission line, the device operates 
in accordance with the control code to realize a 
function corresponding to the control code. 

[0034] According to the twelfth aspect of the present 
invention, the controller does not necessarily have to 
understand each function of a device to be controlled 
since the controller acquires from the device the func- 



tion information including a control code which can be 
interpreted and executed by the device. For example, as 
for a device having a new function not conceivable at 
present, the controller can mate the device execute the 

5 new function by referring to the function Information of 
the device and transmitting the control code to the 
device according to the user's operation performed by 
means of the user interface. Accordingly, the user can 
execute a new function not conceivable at present. 

to [0035] According to a thirteenth aspect of the present 
invention, in the second aspect of the present invention, 

the function information includes a control code cor- 
responding to each of the functions of the device, 
w and 

the device sends the function information to the 
transmission line in response to the predetermined 
request from the controller, and operates in accord- 
ance with the control code received from the con- 
st? -broiler, to realize a function corresponding to the 
control code. 

[0036] The equipment according to the thirteenth 
aspect of the present invention can be used as second 
£5 equipment including the device to be controlled in the 
network control system according to the twelfth aspect 
of the present invention. 

[0037] According to a fourteenth aspect of the present 
invention, in the third aspect of the present invention, 

3D 

the controller acquires the function information 
including a control code corresponding to each of 
the functions of the device from the device through 
the transmission line, and sends the control code in 
35 the function information to the device through the 
transmission line according to the user's operation 
performed by means of the user interface, to control 
the device. 

40 [0038] The equipment according to the fourteenth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the twelfth aspect of the present 
invention. 

45 [0039] According to a fifteenth aspect of the present 
invention, in the first aspect of the present invention, 

the function information includes display data rep- 
resenting each of the functions of the device, and 
so the controller includes display means for displaying 
the functions of the device through the use of the 
display data. 

[0040] According to the fifteenth aspect of the present 
55 invention, the function information has display data rep- 
resenting each function of the device, whereby optimal 
screen display can be presented for each function of the 
device and a user-friendly operational screen display 
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can be realized. 

[0041 ] According to a sixteenth aspect of the present 
invention, in the second aspect of the present invention, 

the function information includes display data rep- s 
resenting each of the functions of the device, and 
the device sends the function Information to the 
transmission line in response to the predetermined 
request from the controller, and operates in accord- 
ance with the control performed by the controller on io 
the basis of the function information, to realize the 
functions of the device. 

[0042] The equipment according to the sixteenth 
aspect of the present invention can be used as second is 
equipment including the device to be controlled in the 
network control system according to the fifteenth aspect 
of the present invention. 

[0043] According to a seventeenth aspect of the 
present invention, in the third aspect of the present 20 
Invention, 

the controller 

comprises display means as the user interface, and 
acquires the function information including display 25 
data representing each of the functions of the 
device from the device through the transmission 
line, and displays each of the functions of the 
device with the display means through the use of 
the display data, to control the device through the so 
transmission line through the use of the function 
information according to the user's operation per- 
formed by means of the user interlace. 

[0044] The equipment according to the seventeenth as 
aspect of the present Invention can be used as first 
equipment including the controller in the network control 
system according to the fifteenth aspect of the present 
invention. 

[0045] According to an eighteenth aspect of the 40 
present invention, in the fifteenth aspect of the present 
invention, 

the function information includes a control code cor- 
responding to each of the display data, 4B 
the controller displays each of the functions of the 
device with the display means through the use of 
the display data included in the function informa- 
tion, and transmits the control code corresponding 
to the display data through the transmission line to bo 
the device according to the user's operation per- 
formed by means of the user interface for the Re- 
play data, and 

the device operates in accordance with the control 
code received from the controller through the trans- ss 
mission line, to realize a function indicated by the 
display data corresponding to the control code. 



[004$] According to the eighteenth aspect, the control- 
ler does not necessarily have to understand each func- 
tion of the device since the controller acquires from the 
device the function information including cfisplay data 
representing each function of the device and a control 
code corresponding to each of the display data. For 
example, as tor a device having a new function not con- 
ceivable at present, the controller can fetch from the 
function information display data representing the new 
function and displays the same on the screen to notify 
the user. Then, when the user understands the new 
function from graphics and the like on the screen and 
selects the function, the controller refers to the function 
information, then obtains a control code corresponding 
to the new function, and transmits the control code to 
the device, to make the device execute the new func- 
tion. Accordingly, the user can execute even a new func- 
tion not conceivable at present 
[0047] According to a nineteenth aspect of the present 
invention, in the sixteenth aspect of the present inven- 
tion, 

the function information includes a control code cor- 
responding to each of the display data, and 
the device sends the function information to the 
transmission line in response to the predetermined 
request from the controller, and operates in accord- 
ance with the control code received from the con- 
troller, to realize a function indicated by the display 
data corresponding to the control code. 

[0048] The equipment according to the nineteenth 
aspect of the present invention can be used as second 
equipment Including the device to be controlled in the 
network control system according to the eighteenth 
aspect of the present Invention. 
[0049] According to a twentieth aspect of the present 
Invention, In the seventeenth aspect of the present 
invention, 

the controller acquires the function information 
including the display data representing each of the 
functions of the device and a control code corre- 
sponding to each of the display data, displays each 
of the functions of the device through the use of the 
display data with the display means, and transmits 
the control code corresponding to the display data 
through the transmission line according to the 
user's operation performed by means of the user 
interface for the display data, to control the device. 

[0050] The equipment according to the twentieth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the eighteenth aspect of the 
present invention. 

[0051] According to a twenty-first aspect of the 
present invention. In the eleventh aspect of the present 
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invention, 

the device QUI layer, the function QUI layer, or the 
sub-device GUI layer includes display data tor each 
of the classified categories, and 
the controller comprises display means tor display- 
ing the user interlace of the device, the function, or 
the sub-device for each of the categories through 
the use of the display data. 

[0052] According to the twenty-first aspect of the 
present invention, the device GUI layer, function GUI 
layer or sub-device GUI layer has display data tor each 
category, whereby optima! screen display can be pre- 
sented for each category. As a result, it is possible to 
provide an operational screen which can deepen the 
user's intuitive understanding and support the user's 
operation. 

[0053] According to a twenty-second aspect of the 
present invention, in the first aspect of the present 
Invention, 

the function information includes audio data tor the 
user interface, and 

the controDer includes audio reproducing means for 
reproducing audio through the use of the audio 
data. 



the device comprises: 

device communication means for communicating 
with the controller through the transmission line; 
and 

5 first control means for sending the function informa- 
tion to the transmission line in response to a prede- 
termined request received from the controller with 
the device communication means, and making the 
device operate in accordance with the control code 

io received from the controDer with the device commu- 
nication means, and 
the controller comprises: 

controller communication means for communicat- 
ing with the device through the transmission line; 
is and 

second control means for acquiring the function 
information from the device by transmitting the pre- 
determined request to the device with the controller 
communication means, and for controlling the 
20 device by transmitting the control code in the func- 
tion information wtth the controller communication 
means according to the user's operation performed 
by means of the user interface. 

25 [0058] According to a twenty-fifth aspect of the 
present invention, in the second aspect of the present 
invention, 



[0054] According to the twenty-second aspect of the 
present invention, the function information has audio w 
data used for the user interface. This makes it possible 
to provide the user with appropriate audio information 
for each device and function and realize a user-friendly 
operational environment. 

[0055] According to a twenty-third aspect of the as 
present invention, in the eleventh aspect of the present 
invention, 

the device QUI layer, the function GUI layer, or the 
sub-device GUI layer includes audio data for each 40 
of the classified categories, and 
the controller comprises audio reproducing means 
for reproducing audio as the user interlace of the 
device, the function, or the sub-device for each of 
the categories through the use of the audio data. 45 

[0056] According to the twenty-third aspect of the 
present invention, the device GUI layer, function GUI 
layer, or sub-device GUI layer has audio data for each 
category, whereby appropriate audio information can be so 
provided to the user for each category. This sup- 
ports/facilitates the user's understanding. 
[0057] According to a twenty-fourth aspect of the 
present invention, in the first aspect of the present 
Invention, 55 

the function Information includes a control code cor- 
responding to each of the functions of the device. 



the device comprises: 

storage means containing therein the function infor- 
mation including a control coda corresponding to 
each of the functions of the device; 
communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, and making the device 
operate in accordance with the control code 
received from the controDer with the communication 
means. 

[0059] The equipment according to the twenty-fifth 
aspect of the present invention can be used as second 
equipment including tie device to be controlled in the 
network control system according to the twenty-fourth 
aspect of the present invention. 
[0060] According to a twenty-sixth aspect of the 
present invention, in the third aspect of the present 
invention, 

the controller comprises: 

communication means for communicating with the 
device through the transmission line; and 
control means for acquiring from the device the 
function information including a control code corre- 
sponding to each of the functions of the device by 
transmitting a predetermined request to tie device 
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with the communication means, and lor controlling 
the device by transmitting the control code in the 
function Information with the communicalJon means 
according to the user's operation performed by 
means of the user Interfaca 

[0061 ] The equipment according to the twenty-sixth 
aspect of the present invention can be used as first 
equipment including the controller In the network control 
system according to the twenty-fourth aspect of the 
present invention. 

[0062] According to a twenty-seventh aspect of the 
present invention, in the first aspect of the present 
Invention, 

the function information includes display data rep- 
resenting each of the functions of the device, 
the device comprises: 

device communication means for communicating 
with the controller through the transmission line; 
and 

first control means for sending the function informa- 
tion to the transmission line with the device commu- 
nication means In response to a predetermined 
request received from the controller, and making 
the device operate in accordance with control infor- 
mation received from the controller with the device 
communication means, and 
the controller comprises: 
display means for the user interface; 
controller communication means for communicat- 
ing with the device through the transmission line; 
and 

second control means for acquiring the function 
information from the device by transmitting the pre- 
determined request to the device with the controller 
communication means, for displaying each of the 
functions of the device with the display means 
through the use of the display data included in the 
function information, and for controlling the device 
by transmitting the control information on the basis 
of the function information with the controller com- 
munication means according to the user's operation 
by means of the user interface. 

[0063] According to a twenty-eighth aspect of the 
present invention, in the second aspect of the present 
invention, 

the device comprises: 

storage means containing therein the function infor- 
mation including display data representing each of 
the functions of the device; 
communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line In response to a predeter- 
mined request received from the controller with the 



communication means, and making the device 
operate in accordance with control information 
received from the controller with the communication 
means. 

0 

[0064] The equipment according to the twenty-eighth 
aqwct of the present Invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the twenty-seventh 
io aspect of the present Invention. 

[0066] According to a twenty-ninth aspect of the 
present invention, in the third aspect of the present 
invention, 
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the controller comprises: 
display means for the user interface; 
communication means for communicating with the 
device through the transmission line; and 
control means for acquiring from the device the 
function information including display data repre- 
senting each of the functions of the device by trans- 
mitting a predetermined request to the device with 
the communication means, for displaying each of 
the functions of the device with the display means 
through the use of the display data, and fa control- 
ling the device by transmitting control information 
on the basis of the function information with the 
communication means according to the user's 
operation performed by means of the user inter- 
face. 



[0066] The equipment according to the twenty-ninth 
aspect of the present invention can be used as first 
equipment including the controller In the network control 
as system according to the twenty-seventh aspect of the 
present invention. 

[0087] According to a thirtieth aspect of the present 
Invention, In the-twenty-seventh aspect of the present 
invention, 

40 

the function Information includes a control code cor- 
responding to each of the display data, 
the first control means in the device mates the 
device operate in accordance with the control code 
45 received from the controller with the device commu- 
nication means to realize a function represented by 
the display data corresponding to the control code, 
and 

the second control means in the controller displays 
so each of the functions of the device with the display 
means through the use of the display data included 
in the function information acquired from the device 
with the controller communication means, and 
transmits the control code corresponding to the dis- 
ss play data with the controller communication means 
according to the user's operation performed by 
means of the user interface for the display data. 
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[0068] Acooncfing to a thirty-first aspect of the present 
invention, in the thirtieth aspect of the present invention, 

the second control means in the controller, when 
any one of the display data is selected by the user s 
based on display provided by the display means, 
transmits the control code corresponding to the 
selected display data with the controller communi- 
cation means. 

10 

[0069] According to a thirty-second aspect of the 
present invention, In the thirtieth aspect of the present 

invention, 

the function information includes one or a plurality 75 
of control codes corresponding to each of the dis- 
play data. 

[0070] According to a thirty-third aspect of the present 
invention, in the twenty-seventh aspect of the present so 
invention, 

the display data is data of a plurality of still pictures, 
and 

the display means in the controller sequentially cits- & 
plays the plurality of still pictures through the use of 
the display data while switching the still pictures at 
a substantially constant time interval. 

[0071] Accorcfing to the thirty-third aspect of the so 
present invention, di^lay data composed of data of a 
plurality of stfll pictures is included in the function infor- 
mation, and the controller sequentially displays the plu- 
rality of still picture data while switching the data at a 
substantially constant time interval. Thus, quasi-motion as 
pictures can be displayed on the screen without an exe- 
cution code operating in the controller, and more easy- 
to-understand operational environment can be provided 
independently of the structure of the controller (the type 
of CPU and the like). *o 
[0072] Accorcfing to a thirty-fourth aspect of the 
present invention, in the twenty-seventh aspect of the 
present invention, 

the display data is data of a plurality of still pictures, 45 
the function information includes display control 
information indicating a display method of the plu- 
rality of still pictures, and 

the display means in the controller displays the plu- 
rality of stiD pictures through the use of the display so 
data in accordance with the display control informa- 
tion. 

[0073] According to the thirty-fourth aspect of the 
present invention, display data composed of data of a ss 
plurality of stiD pictures and display control information 
Indicating a display method of the plurality of still picture 
data are included in the function information. This 



makes it possible to appropriately display quasi-motion 
pictures and stfll pictures according to each scene, and 
specify a reproducing speed and the like of the quasi- 
motion pictures. Consequently, the user can readily 
understand the intention of a creator of the user Inter- 
face such as a QUI. 

[0074] According to a thirty-fifth aspect of the present 
invention, in the twenty-eighth aspect of the present 
invention, 

the function information includes a control code cor- 
responding to each of the display data, and 
the control means makes the device operate in 
accordance with the control code received from the 
controller with the communication means, to realize 
a function represented by the display data corre- 
sponding to the control code. 

[0075] The equipment according to the thirty-fifth 
aspect of the present invention can be used as second 
equipment including the device to be controlled In the 
network control system according to the thirtieth aspect 
of the present invention. 

[0076] According to a thirty-sixth aspect of the present 
invention, in the twenty-ninth aspect of the present 
invention, 

the control means acquires with the communication 
means the function information including the dis- 
play data representing each of the functions of the 
device and a control code corresponding to each of 
the display data, cfisplays each of the functions of 
the device with the display means through the use 
of the display data, and transmits the control code 
corresponding to the display data with the commu- 
nication means according to the user's operation 
performed by means of the user interface for the 
display data, to control the device. 

[0077] The equipment according to the thirty-sixth 
aspect of the present invention can be used as first 
equipment including the controller in the network control 
system according to the thirtieth aspect of the present 
invention. 

[0078] According to a thirty-seventh aspect of the 
present invention, in the first aspect of the present 
invention, 

the function information includes audio data for the 

user interface, 

the device comprises: 

device communication means for communicating 
with the controller through the transmission line; 
and 

first control means for sending the function Informa- 
tion to the transmission line in response to a prede- 
termined request received from the controller with 
the device communication means, and making the 
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device operate in accordance with control informa- 
tion received from the controller with the device 
communication means, and 
the controller comprises* 

audio reproducing means for reproducing audio 
from audio data; 

controller communication means for communicat- 
ing with the device through the transmission line; 
and 

second control means for acquiring the function 
information from the device by transmitting the pre- 
determined request to the device with the controller 
communication means, for reproducing audio with 
the audio reproducing means through the use of the 
audio data included in the function information, and 
for controlling the device by transmitting control 
information on the basis of the function information 
with the controller communication means according 
to the user's operation performed by means of the 
user interface. 

[0079] According to a thirty-eighth aspect of the 
present invention, in the second aspect of the present 
invention, 

the device comprises: 

storage means containing therein the function infor- 
mation including audio data for a user interface; 
communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, and making the device 
operate in accordance with control information 
received from the controller with the communication 
means. 

[0080] The equipment according to a thirty-eighth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the thirty-seventh 
aspect of the present invention. 
[0061] According to a thirty-ninth aspect of the present 
invention, in the third aspect of the present invention, 

the controller comprises: 

audio reproducing means for reproducing audio 
from audio data; 

communication means for communicating with the 
device through the transmission line; and 
control means for acquiring from the device the 
function information Including the audio data for the 
user interlace by transmitting a predetermined 
request to the device with the communication 
means, for reproducing audio with the audio repro- 
ducing means through the use of the audio data 
included in the function Information, and for control- 



ling the device by transmitting control information 
on the basis of the function information with the 
communication means according to the user's 
operation performed by means of the user inter- 



[0092] The equipment according to a thirty-ninth 
aspect of the present invention can be used as first 
equipment Including the controller in the network control 
w system according to the thirty-seventh aspect of the 
present invention. 

[0093] According to a fortieth aspect of the present 
invention, in the thirty-seventh aspect of the present 
Invention, 

15 

the function information includes the audio data for 
the user interface and reproduction control informa- 
tion indicating a reproduction method of the audio 
data, and 

20 the audio reproducing means in the controller 
reproduces audio In accordance with the reproduc- 
tion control Information through the use of the audio 
data. 

£5 [0084] AcconJng to the fortieth aspect of the present 
invention, audio data and reproduction control informa- 
tion indicating a reproduction method of the audio data 
are included in the function information, which makes it 
possible to specify in detail the reproduction method of 

so the audio data in addition to amply presenting audio 
and provide the user with optimal audio information 
according to scene. 

[00&5] According to a forty-first aspect of the present 
invention, in the first aspect of the present invention, 

35 

the device, when there occurs a change in the func- 
tion information, notifies the controDer through the 
transmission line that the change occurs. 

40 [0086] According to the forty-first aspect of the 
present invention, when the status of the dance 
changes, the change in the status is notified to the con- 
troller. This obviates the necessity for the controDer to 
monitor the status of the device. Therefore, the traffic on 

46 the transmission line can be reduced, and the band of 
the transmission line can be effectively used, and more- 
over the load on the controller can be reduced. 
[0087] According to a forty-second aspect of the 
present invention, in the second aspect of the present 

so invention, 

the device comprises: 

storage means containing therein the function Infor- 
mation; 

ss communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 



9 



17 



EP0939517A1 



18 



mined request received from the controller with the 
communication means, notifies, when there occurs 
a change In the function Information, the controller 
with the communication means that the change 
occurs, and making the device operate In accord- 
ance with control information received from the 
controller with the communication means. 

[0088] The equipment according to the forty-second 
aspect of the present Invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the forty-first 
aspect of the present invention. 
[0089] According to a forty-third aspect of the present 
invention, in the third aspect of the present invention, 

the controller comprises: 

communication means for communicating with the 
device through the transmission line; and 
control means for acquiring the function information 
from the device by transmitting a predetermined 
request to the device with the communication 
means, and for controlling the device by receiving, 
when a notification that the function information 
changes is transmitted from the device, the notifica- 
tion with the communication means, and transmit- 
ting control information on the basis of the function 
information with the communication means accord- 
ing to the user's operation performed by means of 
the user interface. 

[0090] The equipment according to the forty-third 
aspect of the present invention can be used as first 
equipment including the controller In the network control 
system according to the forty-first aspect of the present 
invention. 

[0091] According to a forty-fourth aspect of the 
present invention, in the first aspect of the present 
invention, 

the device transmits, when there occurs a change 
in the function information, the changed information 
to the controller through the transmission One. 

[0092] According to the forty-fourth aspect of the 
present invention, when there occurs a change in the 
internal status of the device connected to the transmis- 
sion line, the device notifies the controller of the 
changed information. When receiving the notification, 
the controller can renew, for example, operational 
screen display in response to the changed information 
as required. Thus, the user can readily see the change 
in the status in the device connected to the transmission 
line. 

[0093] According to a forty-fifth aspect of the present 
invention, in the second aspect of the present invention, 

the device comprises: 



storage means containing therein the function infor- 
mation; 

communication means for communicating with the 
controller through the transmission line; and 

5 control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, transmitting, when there 
occurs a change in the function information, the 

iq changed information to the controller with the com- 
munication means, and making the device operate 
In accordance with control information received 
from the controller with the communication means 

is [0094] The equipment according to the forty-fifth 
aspect of the present invention can be used as second 
equipment including the device to be controlled in the 
network control system according to the forty-fourth 
aspect of the present invention. 

20 [0095] According to a forty-sixth aspect of the present 
invention, in the third aspect of the present invention, 

the controller comprises: 

communication means for communicating with the 
25 device through the transmission Gne; and 

control means for acquiring the function information 
from the device by transmitting a predetermined 
request to the device with the communication 
means, and tor controlling the device by receiving, 
30 when changed information in the function informa- 
tion is transmitted from the device, the changed 
information to update the function information, and 
transmitting control information on the basis of the 
function information with the communication means 
35 according to the user's operation performed by 
means of the user interface. 

[0096] The equipment according to the forty-sixth 
aspect of the present invention can be used as first 
40 equipment including the controller in the network control 
system according to the forty-fourth aspect of the 
present invention. 

[0097] According to a forty-seventh aspect of the 
present invention, in the first aspect of the present 
4S invention, 

the device comprises storage means that has a 
non-rewritable area and rewritable area and con- 
tains therein the function information in the non- 
so rewritable area and rewritable area. 

[0098] According to the forty-seventh aspect of the 
present invention, a non-rewritable area and rewritable 
area are included in area in the device where the func- 
55 tion information Is stored. This, It is possible to provide 
not only information fixed to the device but also the infor- 
mation changing with time to the controller in a simple 
configuration. In this way, the changing information can 
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be speedily provided to the user. 

[0099] According to a forty-eighth aspect of the 

present invention, In the second aspect of the present 

invention, 

the device comprises: 

storage means that has a non-rewrttable area and 
rewritable area and contains therein the function 
information in the non-rewritable area and rewrita- 
ble area; 

communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission One with the communication 
means in response to the predetermined request 
received from the controller, and making the device 
operate in accordance with control information 
received from the controller with the communication 
means. 

[0100] According to a forty-ninth aspect of the present 
invention, in the forty-seventh aspect of the present 
invention, 

the device notifies, when information included in the 
function information and stored in the rewritable 
area changes, the controller that the information 
changes 

[0101] According to the forty-ninth aspect of the 
present invention, when the contents in the rewritable 
area change, the device notifies the controller that the 
contents in the rewritable area change, which obviates 
the necessity for the controller to monitor the Informa- 
tion about the device. As a result the traffic on the trans- 
mission fine and the load on the controller can be 
reduced. 

[0102] According to a fiftieth aspect of the present 
invention, in the forty-seventh aspect of the present 
invention, 

the storage means in the device stores a response 
to a request from the controller in the rewritable 
area among the area where the function informa- 
tion is stored. 

[0103] According to the fiftieth aspect of the present 
invention, the device stores a response to the request 
from the controller in the rewritable area in the area 
where the function information of the device Is stored. 
When there are a lot of responses, the device has only 
to write the responses in the rewritable area, and can 
omit the job such as splitting and transmitting the 
responses. As a result, the load on the device can be 
reduced. 

[0104] According to a fifty-first aspect of the present 
invention, in the forty-seventh aspect of the present 
invention, 



the storage means in the device stores status infor- 
mation of the device in the rewritable area among 
the area where the function information Is stored. 

0 [0105] According to the fifty-first aspect of the present 
invention, status information of the device is stored in 
the rewritable area in the area where the function infor- 
mation of the device is stored, which obviates the 
necessity for the controller to issue various commands 

io to confirm the status of the device. Therefore, It Is pos- 
sible to fetch entire information about the controller at a 
time, and reduce the load on the controller and traffic on 
the transmission line. 

[01 06] According to a fffty-second aspect of the 
is present invention, in the forty-seventh aspect of the 
present invention, 

the storage means in the device stores a flag indi- 
cating whether elements forming the function infor- 
20 mation are stored in the rewritable area or in the 
non-rewritable area. 

[0107] According to the fifty-second aspect of the 
present invention, a flag indicating whether the constitu- 
25 ents (e.g. a directory) in the function information of the 
device are disposed in the rewritable area or in the non- 
rewritable area is provided. Accordingly, the controller 
can readily confirm whether information might be rewrit- 
ten or not for each of its constituents. Then, the control- 
so ler has only to check only the information that might be 
rewritten, which reduces the load on the controller. 
[01 08] Accorting to a fifty-third aspect of the present 
invention, in the first aspect of the present invention. 



35 



40 



46 



60 



55 



the function information includes information indi- 
cating contents reproducible by the device. 

[01 09] According to a fifty-fourth aspect of the present 
invention, in the second aspect of the present invention, 

the device comprises: 

storage means containing therein the function infor- 
mation including information indicating contents 
reproducible by the device; 
communication means for communicating with the 
controller through the transmission line; and 
control means for sending the function information 
to the transmission line in response to the predeter- 
mined request received from the controller with the 
communication means, and making the device 
operate in accordance with control information 
received from the controller with the communication 
means. 

[01 10] According to a fifty-fifth aspect of the present 
invention, in the third aspect of the present invention, 

the controller comprises: 
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display means for the user interlace; 
communication means for communicating with the 
device through the transmission line; and 
control means for acquiring from the device the 
function Information Including Information indicating 
contents reproducible by the device by transmitting 
a predetermined request to the device wfth the 
communication means, for displaying the informa- 
tion indicating the contents wfth the display means, 
and for controlling the device by transmitting control 
information on the basis of the function information 
with the communication means according to the 
user's operation performed by means of the user 
interface, 

[01 1 1 ] According to a fifty-sixth aspect of the present 
invention, in the fifty-third aspect of the present inven- 
tion, 

the device notifies, when the contents reproducible 
by the device changes, the controller through the 
transmission line that new contents becomes repro- 
ducible. 

[0112] According to the fifty-sixth aspect of the 
present invention, when the contents reproducible by 
the device changes, the device notifies the controller 
that new contents becomes reproduce, which obvi- 
ates the necessity for the controller to monitor the con- 
tents information. Therefore, the load on the controller 
can he reduced and the configuration can be simplified. 
[0113] According to a fifty-seventh aspect of the 
present invention, in the fifty-third aspect of the present 
invention, 

the device transmits, when contents reproducible 
by the device change, information indicating the 
contents which becomes newly reproducible to the 
controller through the transmission line. 

[0114] According to the fifty-seventh aspect of the 
present invention, when contents reproducible by the 
device change, the device transmits to the controller 
information indicating the contents which becomes 
newly reproducible, which obviates the necessity for the 
controller to monitor the contents Information and fetch 
the contents information thai might frequently change. 
Consequently, the load on the controller can be reduced 
and the configuration can be simplified. 
[01 1 SI According to a fifty-eighth aspect of the present 
invention, in the fifty-third aspect of the present inven- 
tion, 

the device comprises storage means having a 
rewritable area and containing therein the function 
information, and 

the storage means stores in the rewritable area the 
information indicating the contents reproducible by 



the device at present 

[0116] According to the fifty-eighth aspect of the 
present invention, the device stores information about 

5 the contents reproducible at present in the rewritable 
area in the area in the device where the function infor- 
mation is stored. As a result, It is possible to reacfily and 
speedily fetch information which changes with time and 
the contents information to be a basis of the user's oper- 

70 atfon of equipment 

BRIEF DESCRIPTION OF THE DRAWINGS 



[0117] 

is 

FIG. 1 is a block diagram showing a structure of a 
device in a network control system according to a 
first embodiment of the present invention; 
FIG. 2 is a block diagram showing a structure of a 
20 controller in the network control system according 
to the first embodiment; 

FIG, 3 shows an exemplary configuration of the net- 
work control system according to the first embodi- 
ment; 

25 FIG. 4 illustrates an exemplary function list in the 
network control system according to the first 
embocfiment; 

FIG. 5 shows an exemplary structure of a support 
level/maximum transfer amount flag in the function 
30 list in the network control system according to the 
first embodiment; 

FIG. 6 shows an exemplary structure of a still pic- 
ture display flag in the function list in the network 
control system according to the first embodiment; 

55 FIG. 7 shows an exemplary structure of an audio 
reproduction flag In the function list In the network 
control system according to the first embodiment; 
FIG. 8 shows a structure of a function table which is 
an example of the function list in the network control 

40 system according to the first embocfiment; 

FIG. 9 illustrates a function database in the network 
control system according to the first embodiment; 
FIG. 10 illustrates a function list in a network control 
system according to a second embodiment of the 

45 present invention; 

FIG. 1 1 shows a structure of a function table which 
is an example of the function list shown in FIG. 10; 
FIG. 1 2 is a block diagram showing a structure of a 
device in a network control system according to a 

so third embodiment of the present invention; 

FIG. 13 illustrates an exemplary function list in the 
network control system according to the third 
embodiment; 

FIG. 14 shows a structure of an exemplary table 
55 state flag in the network control system according 
to the third embodiment; 

FIG. 15 shows a structure of an exemplary function 
list in the network control system according to the 
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third embodiment; and 

FIG. 16 shows exemplary operation in the network 
control system according to the first embodiment of 
the present invention. 

BEST MODE FOR CARRYING OUT THE INVENTION 

[0118] Hie present invention is described in detail 
below with referring to accompanying drawings. 

< First Embodiment) 



w 



[0119] FIG. 1 is a block diagram showing a device in 
a network control system according to a first embodi- 
ment of the present invention. re 
[0120] It should be noted here that a device in the 
present description refers to an object to be controlled, 
and a controller controls the object. A plurality of 
devices may be Included In one piece of equipment and 
both of the device and controller or either one of them 20 
may be included in one piece of equipment Besides, 
one piece of equipment corresponds to one node on a 
transmission line. A plurality of nodes may be contained 
in one case to constitute an apparatus. 
[0121] In FIG. 1, a reference numeral 1 stands for a 2s 
transmission Bne, 2 for a packet transmitter/receiver, 3 
for a synchronous data transmitterireceiver, 4 for a 
device signal processor, 5 for an asynchronous data 
transmitter/receiver, 6 for a device asynchronous data 
processor, 7 for equipment structure information, 8 tor a 30 
function list, and 9 for an inside-of-equipment controller. 
[0122] Here, the transmission One 1 is, for example, a 
serial bus (hereinafter, referred to as a "1394 bus") 
defined by the IEEE standard 1394 (the IEEE standard 
1394-1995 and other higher level standards compatible 35 
therewith) . The transmission line 1 is not necessarily the 
1394 bus, and may be ATM (Asynchronous Transfer 
Mode), the Ethernet and any other transmission lines. 
[0123] The packet transmitter/receiver 2 physically 
and electrically interfaces to the transmission line 1 . fur- 40 
ther arbitrates in bus-use rights, controls a synchronous 
transfer cycle, and so forth. Besides, the packet trans- 
mitter/receiver 2 selects a packet on the transmission 
line 1 according to a destination thereof to receive the 
packet and transmits a packet onto the transmission 4S 
line 1 . 

[0124] The synchronous data transmitter/receiver 3, 
when transmitting data, manages the transfer rates 
(splits the data) and adds a header to the data. For 
example, in the case where an AV protoool(IEC61883) bo 
standard of the 1394 bus is used, the synchronous data 
transmitter/receiver 3 adds a CIP (Common Iso- 
chronous Packet) header. On the other hand, when 
receiving data, the synchronous data transmit- 
terteceivar 3 rearranges received packets in right order, ss 
removes a header from the data, and so forth. 
[0125] The device signal processor 4 receives syn- 
chronous data from the synchronous data transmit- 



terAeceiver 3, and performs signal processing suited to 
the device. For example, in the case where the device is 
a recording player such as a digital VCR, the synchro- 
nous data is recorded into a storage medium (e.g. a 
magnetic tape). Moreover, the device signal processor 4 
fetches synchronous data from a storage medium, a 
broadcast wave and the Ilka, then transmits the data to 
the synchronous data transmitter/receiver 3, and so 
forth. 

[01 26] The asynchronous data transmitter/receiver 5 
performs transaction processing on asynchronous data 
In accordance with a protocol of a bus. For example, In 
the case where the 1394 bus is used, the asynchronous 
data transmitter/receiver 5 performs processing of read 
transaction, write transaction, lock transaction and the 
like. Note that the asynchronous data transmit- 
ter/receiver 5 may be a software. 
[0127] The device asynchronous data processor 6 
processes asynchronous data received from the asyn- 
chronous data transmitter/receiver 5, or communicates 
the asynchronous data to an appropriate constituent in 
the device. For example, in the case of receiving a com- 
mand as the asynchronous data, the device asynchro- 
nous data processor 6 judges the validity of the 
command, then provides the inside-of-equipment con- 
troller 9 with an instruction corresponding to the com- 
mand when the command is valid. Besides, when the 
equipment structure information 7 is requested from the 
controller, the device asynchronous data processor 6 
sends information included in the equipment structure 
information 7 to the controller through the asynchronous 
data transmitter/receiver 5 in response to the request 
received through the asynchronous data transmit- 
ter/receiver 5 and the Ilka The device asynchronous 
data processor 6 further sends asynchronous data 
received from a constituent In the device to the asyn- 
chronous data transmitter/receiver 5 based on an 
instruction from the inslde-of-equipmerrt controller 9. 
Note that the asynchronous data transmitter/receiver 5 
and the device asynchronous data processor 6 may be 
constituted as one unit. 

[0128] The equipment structure information 7 indi- 
cates information about a structure of the equipment, 
and is described, for example, under a rule specified by 
a configuration ROM in a CSR (Command and Status 
Registers) architecture of the ISO/lEC standard 
13213:1994. When the 1394 bus is employed, the 
equipment structure information 7 has information 
about a bus corresponding to the equipment such as 
whether the equipment supports a bus manager and 
Isochronous operation, a unit directory including infor- 
mation about whether the equipment supports an AV 
protocol, a node ID which Is an identifier of the equip- 
ment, and the like. In the equipment structure informa- 
tion 7, Information Indicating a location of the function 
list 8 is described. 

[0129] The function list 8 is a list of functions of the 
equipment and is stored in predetermined memory 



13 



25 EP 0 939 517 A1 26 



thereof as a function table in the form of a table, for 
example. The function list 8 has a function of the equip- 
ment, one or a plurality of commands corresponding to 
the function, and QUI (Graphical User Interface) infor- 
mation for notifying the user of the function and Indicat- 
ing the status of the equipment when the user selects 
the function. Here, the commands are Included In the 
function list 8 in the form where they can be Interpreted 
and executed by the equipment and are equal to con- 
trol codes which have a broader concept than normal 
commands. That is, the commands are equivalent of 
control codes indicated by various identifiers peculiarly 
specified for the equipment as well as control com- 
mands such as standardized commands and com- 
mands peculiar to the equipment The information of the 
function list 8 is transferred to the controller on the trans- 
mission line 1 through the device asynchronous data 
processor 6, the asynchronous data transmit- 
ter/receiver 5 and the like In response to a request from 
the controDer. 

[0130] The Inside-of -equipment controller 9 controls 
each of its constituents including the inner workings of 
the device and the Oke. In the case where the device 
asynchronous data processor 6 receives a command as 
data, the inside-of-equipment controller 9 controls the 
constituents based on an Instruction from the device 
asynchronous data processor 6 so that the constituents 
operate in accordance with the command. For example, 
in the case where the device is a VCR, and the received 
command is a PLAY command, the inside-of-equipment 
controller 9 sequentially instructs the VCR to perform 
operation such as rotating a drum of the VCR at the pre- 
determined number of revolutions, moving a tape at a 
given speed, fetching a signal from a head on the drum 
to send the signal to the device signal processor 4, and 
the Gke. 

[0131] Operation of the device in response to a 
request and the like from the controller is described as 
follows: When the function list 8 is requested from the 
controller, the device presents the function Gst 8 to the 
controller. When received a command from the control- 
ler, the device performs processing for the command 
according to the circumstances. Thus, the device has 
only to present the function list 8 in response to the 
request for GUI information from the controDer, thereby 
making it possible to decrease the load on the device. 
[01 32] It should be noted that the constituents such as 
the synchronous data transmitter/receiver 3, the device 
signal processor 4 and the Gke may be operationally 
included depending on the functions of the device, or 
may be omitted. 

[01 33] Moreover, the equipment structure information 
7 and the function list 8 of the device are generally dis- 
posed in a non-rewritable memory area, however, may 
be disposed In a rewritable memory area such as a 
flash ROM. 

[0134] Furthermore, each part of the device may be 
formed by either of hardware or software. 



[01 35] FIG. 2 is a block diagram showing the controller 
in the network control system according to the present 
errfcodlmant Here, reference numerals 10 to 14 repre- 
sent a controller signal processor, a controller asynchro- 
5 nous data processor, a function list managing portion, a 
function database, and a screen display/equipment 
function selection portion, respectively. Note that In FIG. 
2, the same constituents as those in FIG. 1 are 
assigned the same numerals, and the description 
70 thereof Is omitted here. 

[0136] The controller signal processor 10 receives 
synchronous data from the synchronous data transmit- 
ter/receiver 8 to perform signal processing suitable for 
the controller. For example, in the case where the cen- 
ts trailer is a video display such as a video monitor, the 
controller signal processor 1 0 decodes the synchronous 
data (e.g. a stream of MPEG2) and displays the data on 
the screen. 

[0137] The controller asynchronous data processor 11 

20 processes asynchronous data received from the asyn- 
chronous data transmitter/recelver 5, or communicates 
the data to an appropriate constituent of the controller. 
In the case where the received asynchronous data is a 
command, the controller asynchronous data processor 

25 1 1 judges the validity of the command, and when the 
command is valid, provides the screen display/equip- 
ment function selection portion 14 with an instruction 
corresponding to the command. Besides, the controller 
asynchronous data processor 11 receives from the 

so packet transmitter/receiver 2 via the asynchronous data 
transmitter/receiver 5 information about devices on the 
transmission line 1 such as connection of a new device, 
disconnection of an existing device and the like and the 
function list 8 of each device, and communicates them 

55 to the function list managing portion 12. Furthermore, 
the controller asynchronous data processor 1 1 sends 
asynchronous data from the constituent of the device to 
the asynchronous data transmitter/receiver 5 based on 
an instruction from the screen display/equipment func- 

40 tion selection portion 14. Note that the asynchronous 
data transmitter/receiver 5 and the controDer asynchro- 
nous data processor 1 1 may be constituted as one unit. 
[01 38] Moreover, in the case where the controDer and 
the device are included in the same equipment, the 

4s functions of the device in the equipment are listed in the 
function list 8 of the device, but not registered in the 
function database 1 3 in the equipment since the control- 
ler grasps the functions of the device, or the inside-of- 
equipment controller 9 directly controls the inside of the 

so equipment. At this time, It is obvious that the location of 
the function list 8 may be described in the equipment 
structure information 7 and also previously registered in 
the function database 13. 

[0139] ft should be noted that in the case where the 
ss controller and the device are included In the same 
equipment, the controller signal processor 10 and the 
device signal processor 4, and the controDer asynchro- 
nous data processor 1 1 and the device asynchronous 
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data processor 6 may be respectively constituted as the 
same unit 

[0140] The function list managing portion 1 2 manages 
information of the function list 8 received from the 
device on the transmission fine 1 . When received from 
the controller asynchronous data processor 1 1 informa- 
tion indicating that a new device i& connected, the func- 
tion list managing portion 12 instructs the controller 
asynchronous data processor 1 1 to read the function list 
8 of the new device. Then, when the function list 8 of the 
new device is read, the function Bet managing portion 12 
registers the information of the function list 8 in the func- 
tion database 13. Moreover, when received information 
indicating, for example, that an existing device on the 
transmission fine 1 is disconnected, the function list 
managing portion 1 2 deletes the corresponding function 
list 8 from the function database 13. When an existing 
device is disconnected, it may be also possible that the 
Information of its function list 8 is saved in a storage (not 
shown in the drawing) in the controller instead of being 
deleted, and thereby, when the device Is connected 
again, the device is identified with the identifier of the 
device and the like, and then the information of the func- 
tion list 8 is read from the storage In the controller and 
registered in the function database 13. In this way, reg- 
istration of the connected devices can be expedited. 
[0141] The function database 13 is disposed in a 
rewritable memory space, and constructed through the 
use of the function list 8 received from the device as a 
database- The database is consulted using the informa- 
tion in the function list managing portion 12, thereby 
making it possfcie to fetching information about each 
device and function and a command corresponding to 
the function and the GUI Information tor notifying the 
user of the function and representing the status of the 
equipment when the user selects the function. 
[0142] The screen display/equipment function selec- 
tion portion 14 notifies the user of the GUI Information 
about the device and function and the like by means of 
video/audio/character information and the like repre- 
senting the GUI information displayed on the screen of 
the controller, selects a device and function in accord- 
ance with the user's operation, makes an instruction for 
execution of each function, and so forth. Besides, the 
screen display/equipment function selection portion 14 
can reproduce/display data (e.g. video and audio data) 
received from the controller signal processor 10 and 
data received from the controller asynchronous data 
processor 1 1 . At this time, the GUI information and the 
like, when displayed, may overlay the video data 
received from the controller signal processor 10. Alter- 
natively, screen display for the GUI information and 
screen display tor the video data may be alternately 
switched based on the user's instruction and the Idee. 
[0143] Furthermore, in the case that the screen dis- 
play/equipment function selection portion 14 provides 
an instruction to the function list managing portion 1 2 to 
retrieve the information of the function list 8, thereby dis- 



playing on the screen graphics representing the device 
on the transmission line 1 and the function thereof (a 
device name, a function name, a still picture sequence 
for display and the Ite). Then, when the user selects 

e graphics representing a function, the screen dis- 
play/equipment function selection portion 14 replaces 
the graphics with graphics tor a selected occasion 
obtained from the Information of the function list 6 to dis- 
play the same, and indicates to the user that the func- 

io tion is selected by reproducing audio data for a selected 
occasion, whereby the user's operation can be sup- 
ported. Then the screen display/equipment function 
selection portion 14 issues a command corresponding 
to the function obtained from the information of the tone- 
rs tion list 8 through the controller asynchronous data 
processor 11 and the like. The screen display/equip- 
ment function selection portion 14 receives via the con- 
troller asynchronous data processor 1 1 a response from 
the device to the command and a status of the device to 

20 which the instruction Is made, then obtains graphics 
data and audio data suitable for the status of the device 
and the like from the Information of the function list 8, 
and displays graphics on the screen or reproduces 
audio to notify the user. 

25 [01 44] Here, it is not always necessary for the control- 
ler to understand each function of the device, For exam- 
ple, as to a device having a new function not 
conceivable at present, the controller fetches graphics 
data and audio data for the new function from the Infor- 

30 mation of the function list 8 and thereby displays graph- 
ics on the screen or reproduces audio, to notify the user. 
Then, when the user understands the new function from 
the graphics or audio and selects the function, the 
screen display/equipment function selection portion 14 

as in the controller refers to the function list 8, then obtains 
a command corresponding to the new function, and 
issues the command to the device- As a result, it is pos- 
sible to execute the newf unction In the device. Thus, the 
above structure enables the user to perform a new func- 

40 tion not conceivable at present. 

[0145] It should be noted that the constituents such as 
the synchronous data transmitter/receiver 3 and the 
controller signal processor 10 may be included option- 
ally according to the function of the controller, or may be 

46 omitted. 

[0146] FIG. 3 shows the system configuration of the 
network control system of the present embodiment. 
[0147] In FIG. 3, a reference numeral 21 stands for a 
television set (TV), 23 for a remote controller for the tel- 

60 evision set, 22 for a personal computer (PC), 31 for a 
DVD-format optical disk capable of recording and repro- 
ducing (DVD), 32 for a DV digital VCR (DVC), 33 for a 
VHS digital VCR (DVHS), 34 tor a DV digital movie cam- 
era (DVC movie), and 35 for a set-top box (STB) for CS 

55 digital broadcast and the Ilka The above-described 
equipment is collectively referred to as 
video/audlo/information equipment The 
videtfaudio/information equipment is interconnected 
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with the transmission line 1 Id constitute an AVC sys- 
tem. The videcteiKfio/information equipment should not 
be limited to the above equipment and Includes cur- 
rently-used equipment (e.g. a printer, a mini-cfisk and 
the lite) and all equipment to come In the future In each 5 
of video, audio and information fields. 
[01 48] The television set 21 Is constituted by a control- 
ler and a device (a terrestrial broadcasting wave tuner 
and a video monitor). The user provides an instruction 
to the screen display/equipment function selection por- 
tion 1 4 in the television set 21 with the remote controller 
23. The PC 22 Is constituted by a controller and a device 
(a modem interfacing with a telephone line, a video 
monitor and the like). The user provides an instruction 
to the screen display/equipment function selection por- 
tion 14 in the PC 22 with a keyboard, a mouse and the 
like. The television set 21 and the PC 22 are defined 
here as equipment in which the devices and controllers 
are combined in one. Among the functions of each 
device in the equipment, a function which can be used 
by other equipment Is described in the function list 8. A 
function of the equipment, however, is not registered in 
the function database 13 in the controller in the equip- 
ment. Note that the television set 21 and PC 22 may be 
defined as equipment constituted by two devices and a 
controller and have the function list 8, for each device in 
the equipment, which is registered in the function data- 
base 13 in the controller in the equipment 
[0149] The DVD 31 and DVC movie camera 34 are 
devices capable of recording and reproducing AV data. 
The DVC 32 and DVHS 33 are equipment each con- 
sisted of a device capable of recorcfing and reproducing 
AV data and a device having the function of a digital 
broadcast tuner. The STB 35 Is a device having the 
function of a tuner for receiving CS digital broadcast 
[0150] While the DVD 31. DVC 32, DVHS 33. DVC 
movie camera 34 and STB 35 are defined as devices 
here, they may be defined as equipment including con- 
trollers and devices regardless of the size if they can 
realize an environment for operating other devices on a 
liquid crystal panel and the like thereof and a user can 
perform operation such as selecting a function of other 
devices by means of a touch panel, a remote controller 
and the like thereof. Alternatively; it is also possible that 
each equipment has a processing function as a control- 
ler and a remote controller for itself, and lets a monitor 
display images and reproduce audio by means of ana- 
log connection, to enable the user to operate the equip- 
ment by manipulating the remote controller while 
viewing a screen of the monitor. In this case, the equip- 
ment may be identified as equipment including a con- 
troller and a device. 

[0151] Fia 4 Illustrates the function list 8 according to 
the present embodiment. 

[0152] In FIG. 4, reference numerals 41 to 44 repre- 
sent a device information layer, a function information 
layer, a function GUI information layer, a device GUI 
layer, respectively. The function list 8 has a tree struc- 



ture with nodes of directories or leaves described later. 
[0153] The function list 8 is mainly composed of two 
layers of the device information layer 41 and the func- 
tion information layer 42, and the device QUI layer 44 
and the function GUI layer 43 are further added to the 
device information layer 41 and the function information 
layer 42, respectively. First the device information layer 
41 shows information about a device, that is, formed by 
attribute information Including device identification Infor- 
mation, specifically, a device name expressing a 
generic name for the device in a character string, a 
device type expressing a type of the device In a code, a 
model name expressing a model of the product speci- 
fied by a manufacturer In a character string, a unique ID 
representing the device and varying with device, and 
the like. Here, the device name may be expressed in a 
code, the device type may be a code or a character 
string expressed by subunittype of AV/C Digital Inter- 
face Command Set (AWC-CTS) discussed by the 1394 
TA (1394 Trade Association), and the unique ID may be 
node.vendorjd or chipjd defined by the 1394 bus. 
[0154] Note that the device information layer 41 has 
even information about the function list 8, and describes 
therein a si^port level of the function list 8, a table size 
in case of realizing the function list 8 in a table form, a 
maximum transfer amount which the device can trans- 
mit in one asynchronous transfer, and the like. The con- 
troller can thus decide only by looking this layer, before 
reading the entire function list 8, whether or not the con- 
troller can support the level of the function list 8, how 
much of the memory space the controller must reserve 
for the function list 8, what amount the controller should 
transfer per one transfer, for example. This makes it 
possible to eliminate unnecessary transfer. 
[0155] FIG. 5 is a block diagram showing an exem- 
plary support level/rnaximum transfer amount flag. 
Here, a reference numeral 51 stands for a support 
level/maximum transfer amount flag. In the support 
level/rnaximum transfer amount flag 51, the first one 
byte (04H in FIG. 5; H means hexadecimal notation) is 
an identifier indicating the support level/maximum trans- 
fer amount flag 51 . The next one byte "Li." expresses in 
a code the level which the function list 8 supports. The 
level here is obtained by classification, for example, 
according to the information included in the function list 
8, and determined based on whether or not a plurality of 
stiD pictures are included in the GUI information, 
whether or not audio data is included therein, and 
whether an execution code executable by the controller 
is included therein. The last two bytes "SS" represent a 
maximum transfer size that the device having the func- 
tion list 8 can transmit in one transfer, and are 
expressed by hexadecimal bytes denoting the maxi- 
mum transfer amount The maximum transfer size 
which can be transmitted in one transfer may be of 
course expressed in a code. 
[0156] Next, the function information layer 42 Indi- 
cates the functions of the device, and is formed, for 
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each function that the device supports, by a function 
name expressing the function in a character string, a 
function type expressing a type of the function In a code, 
a function ID for identifying each function, one or a plu- 
rality of commands corresponding to the function, and 
the like. Here, the function type may be a character 
string. In example of the DVC, the DVC has the func- 
tions such as reproduction, record, stop, fast-forward, 
fast-reverse, still, triple-speed reproduction and the like, 
and creates a directory for each function. In the direc- 
tory, a function name, a function type, a function ID, a 
command and the like are described. The function type 
includes, for example, reproduction, record, tape opera- 
tion and the like. The command includes one or a plural- 
ity of combinations of a command defined by the AV/C- 
GTS, a vendor's unique command and the like, for 
example. The function ID is an identifier having individ- 
ual numbers varying with function in the device. It is 
obvious that the function ID may be differently assigned 
to devices having the same function type, whereby each 
function can be identified with the function type and the 
function ID. It should be noted here that even In a device 
having a new function not conceivable at present, a 
directory for the new function is created in the function 
information layer 42. 

[0157] The function GUI layer 43 indicates user inter- 
lace information about each function. In the function 
GUI layer 43, the directories for individual functions 
obtained by classification in the function information 
layer 42 are further classified according to user's opera- 
tion and the status of the device. A directory is then cre- 
ated for each category resulting from the classification, 
which includes therein a GUI type expressing a GUI 
type In a code, a still picture display flag, a still picture 
sequence for display composed of one or a plurality of 
still pictures, an audio reproduction flag, audio data and 
the like. Here, the GUI type includes, for example, "dis- 
played on screen" used when the function is displayed 
on the screen of the controller, "selected" used when 
the function is selected on the controller screen, "exe- 
cuted" used during the function is being executed by the 
device, "error 11 used when the device does not accept a 
command corresponding to the function from the con- 
troller, and the like. Besides, in the case where a new 
function happens to be a function not conceivable at 
present, it is possible to provide the user with informa- 
tion about the new function by disposing a still picture 
and audio data representing the new function in the 
function GUI layer 43 to transmit the data of the new 
function to the controller. 

[0158] FIG. 6 is a block diagram showing an exem- 
plary still picture display flag as display control informa- 
tion for reproducing a still picture. Here, a reference 
numeral 52 is a still picture display flag. In the still pic- 
ture display flag 52, the first one byte (19H in FIG. 6) is 
an identifier indicating the still picture display flag 52, 
and the next one byte "KK" Indicates the number and 
the presence or absence of stID pictures. The next one 



byte "MM" indicates a method of displaying the still pic- 
ture sequence for display, and express in a code, for 
example, whether the still picture sequence for display 
is displayed in only one cycle or repeatedly, or only the 

5 first still picture Is displayed, and the like. The last one 
byte TP' indicates a cfisplay interval between still pic- 
tures of the still picture sequence for display. The last 
one byte "PP" is expressed, for example, by multiples of 
30 (msec), and only the multiple part is described. 

w Therefore, in the case where a plurality of still pictures in 
the stSI picture sequence for display are displayed, the 
still pictures are sequentially switched at the display 
interval to be displayed on the screen of the controller 
as quasi-motion pictures. 

16 [01 59] FIG. 7 is a block diagram showing an exem- 
plary audio reproduction flag as reproduction control 
information for reproducing audio. Here, a reference 
numeral 53 is an audio reproduction flag. In the audio 
reproduction flag 53, the first one byte (17H in FIG. 7) is 

20 an identifier indicating the audio reproduction flag 53, 
and the next one byte "AA" Indicates the presence or 
absence of audio data. The next one byte "BB U Indicates 
a method of reproducing audio data, and expresses in a 
code, for example, whether audio data is reproduced 

25 only once or repeatedly. It is also possible to specify a 
reproduction interval of audio data in the audio repro- 
duction flag 53 for prompting user's operation. 
(Q1 60] In FIGS. 5 to 7, the identifier of each flag is 
described in accordance with the CSR architecture of 

so the ISO/1 EC 13213:1994 standard, and as the first two 
bits of the identifier of each flag, keyjype of the CSR 
architecture is used. 

[0161] The device GU I layer 44 is a hierarchy indicat- 
ing user interface information of the device, and is clas- 
3s sified according the user's operation and the status of 
the device. Each category resulting from the classifica- 
tion has a GUI type expressing a type of GUI in a code, 
the still picture display flag 52, a still picture sequence 
for display composed of one or a plurality of still pic- 
«> tures, the audio reproduction flag 53, audio data and the 
like The GUI type here includes, for example, "displayed 
on screen" used when the device is displayed on the 
screen of the controller, "selected" used when the 
device is selected on the controller screen, "in opera- 
te tion" used during the device is in operation, "in use" 
used when the device is used by another controller, 
"error used when the device does not accept an 
instruction from the controDer, and the like. 
[01 62] FIG. 8 is a diagram showing a function table 
bo which is an example of the function let 6 in the present 
embodiment. In FIG. 8, an address space in memory is 
expressed by a portrait format rectangle, and 4 bytes 
wide. The "Length" in the drawing expresses a size of 
contents of a directory or leaf equivalent of individual 
55 nodes forming a tree structure of the function list 8 as 
multiples of 4 bytes, and "CRC" is cyclic redundancy 
check bits. Note that the addresses here are assigned 
for convenience in explanation and therefore can be 
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arranged arbitrarily, or the constituents may be respec- 
tively identified with identifiers. 
[0163] The directory beginning with "Address=430H n , 
for example, is equivalent of a unit cSrectory of the CSR 
architecture, and defines therein a function table entry 
indicating a location of the function list 8 (Address - 
440 H). Information in an area from Address = 430H to 
440H is included in the equipment structure information 
7. 

[0164] The Information of the function list 8 Is 
described in Address - 800H and thereafter. The device 
information layer 41 is disposed In an area from 
Address 800H to an address just before Address » 
S00H, the function Information layer 42 in an area from 
Address « 900H to an address just before Address - 
A00H, and the function QUI layer 43 in an area from 
Address = A00H and thereafter. 
[0165] In FIG 8, each of the function table entry, the 
device name entry and the like has an identifier for Iden- 
tifying an entry type thereof in the first one byte, and 
indicates a relative address value to each directory or 
leaf in the remaining three bytes. Note that keyjyps of 
the CSR architecture is used as the first two bits of the 
identifier. 

[01 66] In this way, the directory structure reserving a 
variable area for each category such as a function, GUI 
and the like and for each constituent is constructed. 
This makes it possible to effectively use a memory area 
storing the function list 8 and readily retrieve each cate- 
gory and constituent. 

[0167] While an area from Address = K30H to an 
address just before Address - 900H is defined as the 
device information layer 41 here, some of information 
included In the device information layer 41 may be 
described in a part of the equipment structure informa- 
tion 7, and In this case, the device information layer 41 
is formed by a pluraDty of directories. Similarly, the other 
layers may be respectively formed by a plurality of direc- 
tories if the relation between layers is clear. 
[0168] FIG. 9 illustrates the function database in the 
first embodiment. Referring to FIG. 9, the operation of 
the controller is described. 

[0169] In FIG. 9, when a device is connected to the 
transmission line 1 , a controller on the transmission line 
recognizes the new device by means of bus reset and 
the like in the case of the 1394 bus, for example, then 
reads the function list 8 from the new device through the 
transmission line 1 according to an instruction from the 
function list managing portion 12, and copies and regis- 
ters the function list 8 into the function database 13 in 
the controller. Here, the function Est 8 is identified with a 
memory address in which the function list 8 is disposed, 
the unique ID and the like, and has a directory structure 
having an entry for each device. 
[0170] The screen display/equipment function selec- 
tion portion 1 4 refers to information of the function list 8 
in the function database 13 through the function list 
managing portion 12. When the screen display/equip- 



ment function selection portion 14 displays a list of 
devices connected to the controller according to an 
Instruction such as the user's operation of the remote 
controller, the screen display/equipment function selec- 

5 tion portion 14 reads the device name and device type 
in the device information layer 41, the still picture 
sequence tor display in the device QUI layer 44, and the 
like from the function lists 8 of aD devices registered in 
the function database 13 through the use of information 

w in the function list managing portion 12, and displays 
the same on the screen. Here, the devices are identified 
with the memory addresses in which their function lists 
8 are disposed, their unique IDs and the like. All infor- 
mation in the device information layer 41 is not neces- 

75 sarily displayed on the screen, of course, and may be 
appropriately selected and displayed. Besides, accord- 
ing to the usage condition of each equipment the still 
picture sequence for display and the like for the used 
occasion may be read from the device QUI layer 44 and 

20 displayed on the screen, thereby providing a more user- 
friendly device list Here, the audio data in the "dis- 
played on screen" category In the device GUI layer 44 is 
not used in displaying the device list. For example, when 
a new device is connected while the device list Is dis- 
ss played, the still picture sequence for display of the new 
device is displayed and the audio data in the "displayed 
on screen" category is reproduced. 
[0171] Next, in the case that the user selects, for 
example, the DVC having the unique ID "YYY1" with a 

so pointing function (e.g. a cross key) of the remote con- 
troller 23 and the like, the screen display/equipment 
function selection portion 14 reads the still picture 
sequence for display for the selected occasion and the 
like In the device GUI layer 44, and displays the same 

$5 on the screen in accordance with the still picture display 
flag 52. Then, the screen display/equipment function 
selection portion 14 reads the still picture sequence for 
display in the function GUI layer 43 for each function 
described in the function information layer 42 from the 

40 function list 8 of the device with using the function list 
managing portion 12, and displays the same on the 
screen based on an instruction of the still picture display 
flag 52. Graphics representing all functions of the 
device is thus displayed on the screen. Here, the 

45 respective functions are identified with the function ID in 
the function Information layer 42 and the memory 
addresses in which the function information is disposed, 
and the types of GUI are identified with the GUI type 
and the memory addresses in which the various types 

so of GUI information are disposed. Of course, it is also 
possible to define IDs for GUI and then uniquely assign 
the numbers to the various types of GUI to manage the 
types. This facilitates the management and enables a 
plurality of functions to share a GUI, whereby memory in 

55 the equipment can be reduced. Here, since each func- 
tion has screen display data, it is possible to flexibly 
cope with the case where the enough space for display- 
ing the screen display data of ail functions can not be 
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reserved due Id constraints such as relation wrth other 
display items and resolution of the screen, by displaying 
only the function names but not the graphics as for 
some functions, changing the layout relation among the 
graphics of functions, and so forth. 5 
[0172] Furthermore, in the case where the user moves 
a cursor onto the graphics representing a reproduction 
function of the device, for example, by means of the 
pointing function of the remote controller, the screen 
display/equipment function selection portion 14 fetches 
audio data in the "displayed on screen" category in the 
function QUI layer 43 whose function Information layer 
is for reproduction from the function list 8 of the device 
while using the function list managing portion 12 again, 
reproduces the audio data based on the instruction of 
the audio reproduction flag 53. The audio data may be 
audio for explaining the function, some melody, or audio 
indicating a selection method, for example. Here, in the 
case where the user moves the cursor onto the graphics 
representing the reproduction function, the screen dis- 
play/equipment function selection portion 14 repro- 
duces audio data not immediately but only when the 
cursor has been stiO located on this position even after 
a lapse of time (e.g. almost a second) required to pre- 
dict that the user's intention is directed to the function. 
[0173] Next, In the case where the user selects the 
graphics representing the reproduction function of the 
device, for example, by means of the pointing function of 
the remote controller and the like, the screen dis- 
play/equipment function selection portion 14 fetches 
one or a plurality of commands corresponding to the 
function from the function list 8 of the device, and 
sequentially transmits the commands to the device. The 
command here Is a command indicating a function, 
function ID of the function, identifier of the graphics, or 
the like. The screen display/equipment function selec- 
tion portion 14 then monitors the status of the device, 
and when an operation mode of the device becomes a 
desired operation mode (here, the reproduction status), 
displays a reproduced picture from the device on the 
screen. At the same time, the screen display/equipment 
function selection portion 14 fetches the selected still 
picture sequence for display and audio data for the 
selected occasion in the function QUI layer 43 whose 
function information layer 42 is for reproduction func- 
tion, then displays the still picture string for display over 
the graphics representing the reproducing function in 
the manner indicated by the still picture display flag 52, 
and replays the audio data based on the instruction of 
the audio reproduction flag 53. The audio data may be 
audio for explaining the operation of the function and the 
state of the device, or some melody. While the status of 
the device is monitored here, when the status of the 
device changes, the device asynchronous data proces- 
sor 6 and the Inside-of-equipment controller 9 In the 
device may notify the change in the status to the control- 
ler which transmits a command causing the change. In 
this case, the controller does not have to monitor the 



status of the device, thereby reducing the traffic on the 
transmission line 1. Consequently, the band of the 
transmission One 1 can be effectively used and the load 
on the controller can be reduced. 
[0174] Moreover, In the case where the device can not 
accept the command transmitted by the controller for 
some reason, the screen display/equipment function 
selection portion 14 senses that the device does not 
accept the command based on the response to the 
transmitted command, the result of the monitoring of the 
device status and the like. Hie screen display/equip- 
ment function selection portion 14 than fetches the stfll 
picture sequence for display and audio data for the error 
occasion in the function GUI layer 43 whose function 
information layer 42 is for reproduction function, then 
displays the still picture sequence for display over the 
position of the graphics representing the reproduction 
function in the manner indicated by the still picture dis- 
play flag 52, and at the same time, reproduces audio 
data based on the instruction of the audio reproduction 
flag 53. The audio data may be sound tor explaining the 
status of the device, some beep tones, or some melody, 
for example. While the still picture sequence for display 
for the error occasion is displayed over the position of 
the graphics representing the reproduction function 
here, it may be widely displayed in a conspicuous posi- 
tion such as a center of the screen. 
[01 75] All screen display data and audio data as for 
each device and function is transferred from the device 
in the present invention. However, in the case where 
varying screen display data is received from a plurality 
of DVCs, for example, as for a common function among 
the DVCs, screen display data for the function existing in 
the function list 8 of any one of the DVCs may be used, 
and as for a function unique to a DVC, screen display 
data in the DVC may be used. Moreover, the controller 
may previously have screen display data for a general 
function therein, to use the screen display data for the 
general function. While the description was made with 
an example of screen display data here, audio data may 
be of course used similarly. In this way, screen display 
data for a function and device is shared among some 
devices, which makes it possible to keep consistency of 
screen display provided by the controller and display at 
the time of operation. 

[0176] Furthermore, while the screen display/equip- 
ment function selection portion 14 perform its display 
and reproduction operation in accordance with the still 
picture cfisplay flag 52 and audio reproduction flag 53 
here, the screen display/equipment function selection 
portion 14 may specify display and reproduction meth- 
ods by itself in advance, or determine display and repro- 
duction methods with referring to the stfll picture display 
flag 52 and audio reproduction flag 53. The screen dis- 
play/equipment function selection portion 14 thus deter- 
mines displaying/reproduction methods, thereby 
keeping consistency of the operational environment 
[0177] ft should be noted that one or some of the 
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device information layer 41, the function information 
layer 42, the function QUI layer 43, and the device QUI 
layer 44 may be omitted according to the ability and 
function and the like of the equipment as required. 
[0178] FIQ. 16 shows an exemplary operation in the 
network control system in the present embodiment 
[0170] In the network control system In the present 
embodiment, when a device is newly connected to the 
transmission line 1 , the controller 1 recognizes the new 
device, for example, by means of bus reset and the like 
in the case of the 1 394 bus, and transmits a function list 
read request through the transmission line 1 to the new 
device, in response to the request, in the new device, 
the device asynchronous data processor 6 receives the 
request via the asynchronous data transmitter/receiver 
5 and the like, and transmits the information of the func- 
tion list 8 via the asynchronous data transmitter/receiver 
5 and the like to the controller. Note that the controller 
may read the function list 8 from the device through the 
transmission line together with the function list read 
request 

[01 80] The controller thus acquires the information of 
the function list 8 from the new device, then copies and 
registers the information of the function Gst 8 to/in the 
function database 13. After the information of the func- 
tion list 8 is registered, the screen display/device func- 
tion selector 1 4 of the controller displays the operational 
screen display through the use of the QUI information 
corresponding to the new device, the QUI information of 
the function and the like. Thus, the graphics represent- 
ing the new device and the function thereof is displayed 
on the screen in addition to the graphics representing 
the devices already registered in the function list 8 and 
the functions thereof. 

[0181] TTie user operates with respect to the opera- 
tional screen display in the controller obtained in the 
above manner to select a function of a predetermined 
device provided on the operational screen display, 
whereby a control code corresponding to the function is 
issued to the selected device. That is, the screen dis- 
play/device function selector 14 retrieves a control code 
corresponding to the graphics and the like manipulated 
by the user from the function database, and transmits 
the control code, instructing the device to execute the 
function represented by the graphics, to the selected 
device. The device which receives the control code 
interprets and executes the instruction indicated by the 
control code. Specifically, the operation specified by the 
control code is executed by the inside-of-equipment 
controller 9. After the operation is executed, the device 
transmits a response to the issued instruction to the 
controller. The controller receives the response to rec- 
ognize that the issued instruction Is property performed, 
and renews the operational screen display as required. 
In the case of receiving the response indicating occur- 
rence of an error such as the case that the instruction is 
not properly performed In the device, the controller 
fetches the still picture sequence for display and the lite 



for the error occasion from the function list 8 of the 
device, and thereby displays an error indication with 
using the same. 

[0182] Communications made between the controller 
5 and the device through the transmission line 1 in the 
above way enables the user to make an instruction in 
the operational screen display for the device connected 
to the transmission line including a newly-connected 
device. In response to the Instruction, the device is con- 
w trolled wKh the function list to perform the function 
desired by the user. During such operation, when a 
change occurs In the Internal status of the device con- 
nected to the transmission line 1 , the device notifies the 
controller of Information in which the change occurs by 
15 means of a predetermined identifier, for example. Upon 
receiving the notification, the controller deals with the 
change in Information, and renews the operational 
screen display as required. In this way, the user can 
easily see a change In the status of the device con- 
st? nected to the transmission line 1 . 

[0183] The present embodiment described above 
comprises a controller having a user interface and a 
device having a function Gst indicating functions thereof, 
in which the device transmits the function 1st through a 
25 transmission One to the controller, and the controller 
notifies the Information about the device to a user with 
using the function list and controls the device with the 
function list according to an instruction from the user, 
thereby making It possible to realize a user-friendly 
so operational environment in a simple configuration and 
readily adapt to a device having a new function not con- 
ceivable at present. Moreover, the controller has the 
function lists of all devices which can be used, to speed- 
ily display the information about each device. 
35 [0184] Besides, a device information layer indicating 
the Information about the device and a function informa- 
tion layer indicating the functions of the device are pro- 
vided in the function list, which respectively optimizes 
operational environments for each device and function 
40 of the device. Consequently, a user-friendly operational 
environment can be realized. 
[018$] A device QUI layer and a function QUI layer 
describing user interface information about the dwice 
shown in the device information layer and function infor- 
ms mation layer are further included, which making it possi- 
ble to construct a flexible operational environment for 
each device or function. 

[0186] Moreover, the function information layer is clas- 
sified for each function of the device to rave one or a 

so plurality of commands for each function. This makes it 
possible to customize a user interface for each function, 
unify display of functions of all devices when displayed 
on the controller, and provide an easy-to-understand 
operational environment for a new function not conca'v- 

s? able at present 

[0187] Besides, an identifier is provided for each func- 
tion described in the function Information layer, thereby 
facilitating idenftlcatian and retrieval of a function when 
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managing or retrieving the function Get with the control- 
ler. 

[0188] The device QUI layer or function QUI layer is 
classified according to the operation of the user and the 
status of the device, which makes it possible to easily s 
construct a user-friendly and easy-to-understand user 
interface. 

[0189] Moreover, the function Get has screen display 
data representing a device or function, thereby provid- 
ing optima! screen display as for each device and func- 
tion and providing a user-friendly operational screen 
display. 

[01 90] The device QUI layer or function QUI layer has 
screen display data tor each category. Optimal screen 
display thus can be provided as for each category in 
each hierarchy, to deepen user's intuitive understanding 
and provide an operational screen display capable of 
supporting usefs operation. 
[01 91 ] The function list includes screen display data 
which is data of a plurality of still pictures, and the con- 
troller sequentially displays the plurality of still picture 
data while switching the data every given time period. 
Thus, quasi -motion pictures can be displayed on the 
screen without an execution code operating in the con- 
troller, and more easy-to-understand operational envi- 
ronment can be provided Independently of the structure 
of the controller (a type of the CPU and the Gke). 
[0192] Furthermore, the function Gst further includes 
screen display data consisting of data of a plurality of 
still pictures and a flag indicating a display method of 
the plurality of still picture data. This enables display of 
quasi-motion pictures, still pictures and the like suitable 
for each scene and specification of a reproducing speed 
ol the quasi-motion picture. As a result, the intention of 
a GUI's creator becomes clearer to the user. 
[0193] Besides, the function list further includes audio 
data, used for the user interface, such as audio data tor 
a device or a function and the lite, which makes it pos- 
sible to provide the user with audio information appro- 
priate for each device and function and realize a user- 
friendly operational environment 
[01 94] TTie device QUI layer or the function QU I layer 
has audio data for each category, to provide the user 
with audio information appropriate for each category in 
each hierarchy and support/facilitate the user's under- 
standing. 

[01 95] Furthermore, the function Gst further includes 
audio data and a flag indicating a reproduction method 
of the audio data. Thus, it is possible to specify the 
reproduction method of the audio data in detail in addi- 
tion to simply offering audio, and provide the user with 
optimal audio information according to the scene. 

< Second embodiment) 

[01 96] A second embocfiment of the present invention 
is described below with referring to the drawings. 
[0197] FIG. 10 illustrates a function Gst in a network 



control system according to the second embodiment of 
the present invention. 

[01 98] In FIG. 10, reference numerals 45 and 46 rep- 
resent sub-device information layer indicating informa- 
tion about a sub-device and a sub-device QUI layer 
intfcating QUI information for the sub-device, respec- 
tively. Here, the same constituents as those in the first 
embodiment are assigned the same reference numerals 
and the description thereof is omitted Note that the 
sub-device In the present description refers to each 
device in the case where a plurality of devices are con- 
tained in one piece of equipment and the plurality of 
devices are collectively referred to as a device. For 
example, in the case of the DVHS 33 shown In FIG. 3, a 
digital terrestrial wave tuner and VCR capable of record- 
ing/reproducing video are respectively referred to as 
sub-devices. 

[0199] FIG. 10 shows an example of the DVHS 33 
equipped with the digital terrestrial wave tuner (TV 
tuner). In the device information layer 41, the device 
name, the device type, the model name, the unique ID 
and the like are described as information about the 
device. In the device QUI layer 44, the still picture 
sequence tor display, the audio data and the like are 
described as QUI information of the device. 
[0200] The siixievice information layer 45 is placed 
below the device information layer 41 and contains 
information about each sub-device (the TV tuner and 
the D-VCR in the present embodiment). Note that items 
described in the sub-device information layer 46 are a 
sub-device name denoting a name of a sub-device, a 
sub-device type expressing a type of the sub-device in a 
code, a sub-device ID for identifying the sii)-device, and 
the like. The sub-device type Is, for example, code data 
expressed by subunrtjype of AV/C-CTS discussed by 
the 1 394TA. The sub-device ID is obtained by assigning 
different numbers to each sub-device in one device, it is 
of course possible that different numbers are assigned 
to sub-devices of the same sub-device type as sub- 
device IDs. In this case, each sub-device is identified 
with the sub-device type and sub-device ID. 
[0201 ] As in the case with the device information layer 
41 and the function information layer 42, the sub-device 
information layer 45 has a sub-device QUI layer 46 in 
which QUI information of a sub-device (a still picture 
sequence for display, audio data and the ID®) is 
described. 

[0202] The sub<levJce QUI layer 46 is classified 
according to the user's operation and the status of the 
device, Each category resulting from the classification 
has a QUI type expressing a type of a QUI in a code, the 
still picture display flag 52, a stiD picture sequence for 
display composed of one or a plurality of still pictures, 
the audio reproduction flag 53, audio data and the like. 
Here, the QUI type Includes, for example, display on 
screen" used when a device is cfisplayed on the screen 
of the controller, "selected" displayed when the device is 
selected on the screen of the controller, "in operation" 
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displayed on the screen of the controOer when the 
device is in operation, "in use" used when the device is 
used by another controller, "error" displayed on the 
screen of the controOer when the device does not 
accept an instruction from the controller, and the like. 5 
Note that in the "displayed on screen" category of the 
GUI type, Information Indicating description, specifica- 
tion and operational method of the sub-device may be 
included. 

[0203] Below the sub-device Information layer 45, io 
placed is function information layer 42. To the function 
information layer 42, the function QUI layer 43 Is added. 
The function information layer 42 and the function GUI 
layer 43 are Identical with those in the first embodiment 
and the description thereof is omitted here. w 
[0204] FIQ. 1 1 is a block diagram showing a function 
table which is an example of the function list In the sec- 
ond embodiment As in the case with the function infor- 
mation entry In the first embodiment, a sub-device entry 
is disposed in the memory area of the device infbrma- so 
tion layer 41 . In the present embodiment, the area of the 
sub-device Information layer 45 is disposed subsequent 
to the device information layer 41. In the sub-device 
information layer 45, a sub-device GU I entry and a func- 
tion information entry are 25 
disposed. Note that each of a sub-device entry, sub- 
device name entry and the like here has an identifier for 
identifying the type of entry in the first one byte and indi- 
cates a relative address value to each directory or leaf 
in the remaining three bytes as in the case with the first 30 
embodiment. The first two bits of the identifier employ 
keyjype expressed by the CSR architecture. 
[0205] Description of the operation of the present 
embodiment Is omitted here since It is the same as that 
in the first embodiment except that a unique ID and a & 
sub-device ID are used for identifying a device in place 
of the unique ID. The sub-device ID is also used, when 
the controller controls the device, as a destination used 
when the controller transmits a command to the device. 
[0208] As described in the above, the device infbrma- 40 
tion layer indicating information about a device, the sub- 
device information layer indicating information about a 
sub-device in said device, and the function information 
layer indicating functions of said sub-device are pro- 
vided. It is thus possible to provide an appropriate oper- 45 
ational environment for each sub-device in each device, 
and control each device on a sub-device basis from dif- 
ferent controllers. 

[0207] The sub-device GUI layer describing user inter- 
face information of the sii)-device indicated in the sub- so 
device information layer 45 is provided, whereby a flexi- 
ble user interface can be constructed for each sub- 
device and an optimal and user-friendly operational 
environment can be realized for each sub-device. 

55 

(Third Embodiment) 

[0208] Described below is a third embodiment of the 



present invention with referring to the drawings. 
[0209] FIQ. 1 2 is a block diagram showing a structure 
of a device in a network control system according to the 
third embodiment 

[0210] In FIQ. 12, a reference numeral 15 stands for 
ROM (Read Only Memory) as a non-rewritable memory 
area where a part of the function list 8 is disposed, and 
a reference numeral 16 stands for RAM (Random 
Access Memory) as a rewritable memory area where a 
part of the function list 8 Is disposed. Constituents iden- 
tical with those in the first embodiment are assigned the 
same reference numerals and the description thereof Is 
omitted. 

[021 1] In the present embodiment, the function list 8 
is disposed not only in ROM 15 but also in RAM 16. In 
RAM 1 6 where the function list 8 is disposed, the inside- 
of-equlpment controDer 9 writes information as required. 
The information to be written here is, for example, infor- 
mation Indicating the contents, that is, attribute informa- 
tion including identification information for the contents 
(hereinafter, such attribute information for the contents 
is simply referred to as "contents Information"), more 
specially, currently-broadcast program information 
(information about the title of the program, title screen 
display, theme music, synopses, cast, and the lite) in 
the case of the STB, and information about the contents 
recorded in a DVD disk (information about the title, title 
screen, theme music, synopses, cast, and the lite) in 
the case of the DVD. Additionally, identification informa- 
tion of the controDer using the device, status information 
of the equipment may be written in RAM 16. 
[021 2] FIG. 13 illustrates an exemplary function list in 
the present embodiment The example for the STB is 
described. It should be noted that the device GUI layer 
44 is omitted here. 

[0213] In FIG. 13, In RAM 16 in the function list 8, 
every time the contents broadcast on each channel of 
the STB change, the inside-of-equipment controller 9 
rewrites the corresponding part in the function informa- 
tion layer 42 and the function GUI layer 43. For example, 
in the case where the broadcast contents on a channel 
101 (101 ch) change, the inside-of-equipment controller 
9 rewrites the still picture sequence for display and 
audio data for "displayed on screen" in the function GUI 
layer 43. If the still picture display flag 52 and audio 
reproduction flag 53 must be rewritten to change the still 
picture sequence for display and audio data, the still pic- 
ture display flag 52 and audio reproduction flag 53 are 
rewritten at the same time. Moreover, in the case where 
a command controlling the device is changed due to the 
change in the broadcast contents, for example, the cor- 
responding function information layer 42 is rewritten. 
When the broadcast on the channel ends, the function 
information layer 42 and the function GUI layer 43 are 
deleted. 

[0214] Note that a table state flag is added to the func- 
tion information layer 42 In the present errtxxfiment 
[0215] FIG. 14 is a block diagram showing an eram- 
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piary table state flag in the present embodiment A ref- 
erence numeral 54 represents the table state flag where 
the first one byte (13H In FIG. 14) Is an Identifier indicat- 
ing the table state flag 54, and the next four bits TT 
express In a code whether the Information correspond- $ 
ing to each of the function in the function information 
layer 42 is disposed In a non-rewritable area or a rewri- 
table area. The remaining twenty bits "W represents 
version information and is a figure to which one is added 
each time the information in RAM 16 where the function 
list 8 is disposed is rewritten. It is obvious that in the 
case where the Information in RAM 16 might be fre- 
quently rewritten, the flag may be extended to have 
more bits for the version information. 
[0216] FIG. 1 5 is a block diagram showing an exem- 
plary function list in the third embodiment. FIG. 15 
shows the function information layer 42 and function 
GUI layer 43 which have areas as shown in FIG. 15 for 
each function. The items In the area of the table state 
flag 54 are set depending on the areas where the func- 
tion information layer 42 and function GUI layer 43 are 
disposed. 

[0217] Each entry and the nke in the areas has an 
identifier for Identifying the type of entry in the first one 
byte as in the case with the first embodiment, and indi- 
cates a relative address value to each directory or leaf 
in the remaining three bytes. Note that keyjype 
expressed in the CSR architecture is used here in the 
first two bits of the identifier. 
[0218] Described next is operation of the present 
embodiment 

[0219] First, when a device is connected to the trans- 
mission line 1, a controller on the transmission line 1 
recognizes the new device, for example, by means of 
bus reset and the like in the case of the 1394 bus, then 
reads the function list 8 from the new device with using 
the function list managing portion 12, and copies and 
registers the information of the function list 8 tofln the 
function database 13 of the controller. The screen dis- 
play/equipment function selection portion 14 refers to 
the function list 6 En the function database 13 through 
the function Est managing portion 12. When the list of 
devices connected to the controller is displayed accord- 
ing to the user's manipulation of a remote controDer and 
the I Iks, the screen display/equipment function selection 
portion 14, while using the function list managing por- 
tion 12, reads the device name and device type in the 
device information layer 41 , the still picture sequence for 
display in the device GUI layer 44, and the like from the 
function lists 8 of all devices registered in the function 
list managing portion 12, and displays the same on the 
screen. 

[0220] Next, when the user selects, for example, the 
STB whose unique I D is XXXX by means of the pointing 
function of the remote controller (e.g. a cross key) and 
the like, the screen display/equipment function selection 
portion 14 reads the still picture sequence for display 
and the like for the selected occasion in the device GUI 



layer 44, and displays the same on the screen. After 
that the screen display/equipment function selection 
portion 14, while using the function Qst managing por- 
tion 1 2, reads the still picture sequence for display in the 
function GUI layer 43 for each function described in the 
function information layer 42 from the function list 8 of 
the device, and display the same on the screen based 
on an instruction from the still picture display flag 52. In 
this way, the graphics representing the functions and the 
contents Information of the device is displayed on the 
screen. The screen display/equipment function selec- 
tion portion 14 grasps the possibility that the each func- 
tion is rewritten and version information from the table 
state flag 54 through the function list managing portion 
12. In the case there is possibility that a function is 
rewritten, the function list managing portion 12 monitors 
the corresponding function in the function list 8 of the 
device at periodic time intervals. While the function list 8 
of the device is monitored here at periodic time inter- 
vals, the function list 8 of the device may be checked 
when a cursor is located on or moved onto graphics rep- 
resenting the function which might be rewritten. Thus, 
the traffic on the transmission line 1 can be decreased, 
and update Information can be provided In accordance 
with the user's intention. 

[0221] Furthermore, for example, when the user 
moves the cursor onto graphics representing the con- 
tents information of the 101ch by means of the pointing 
function and the like of the remote controller, the screen 
display/equipment function selection portion 14, wh3e 
using the function list managing portion 12 fetches 
aixfio data again in the "displayed on screen" category 
In the function GUI layer 43 whose function information 
layer is for 1 01 ch, and reproduces the audio data based 
on an instruction of the audio reproduction flag 53. The 
audio data may be, for example, audio explaining the 
function, some melody, or audio indicating a selection 
method. In the case where the user moves the cursor 
onto graphics representing the reproduction function of 
the device, the screen display/equipment function 
selection portion 14 reproduces audio data not immedi- 
ately but only when the cursor has still been located in 
the present position even after a lapse of time (ag. 
almost a second) required to predict that the user's 
intention is directed to the function. 
[0222] The operation in the case that the user selects 
graphics representing each function, for example, the 
contents Information of the 101 ch and that the device 
does not accept the command transmitted by the con- 
troller for some reason is the same as that in the first 
embodiment, and therefore the description thereof is 
omitted. 

[0223] When the Information in the device that might 
be rewritten (e.g. the contents information) changes, the 
device rewrites a directory Indicating the corresponding 
function in the function information layer 42 in its func- 
tion list 8. In the controller, the function list managing 
portion 12 monitors at periodic time Intervals a function 
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that might be rewritten in RAM 16 in the function Gst 8 in 
the devica When the corresponding function in RAM 1 6 
In the function list 8 in the device is rewritten, the func- 
tion list managing portion 12 fetches new data of the 
corresponding function via transmission One 1, then 
rewrites the corresponding function in the function list 8 
of the device In the function database 13, and notifies 
the screen display/equipment function selection portion 
14 that the corresponding function is rewritten. In 
response to this, the screen display/equipment function 
selection portion 14 fetches screen display data and the 
like of the corresponding function from the function list 8 
in the function database 13, and cGsplays the same on 
the screen or reproduces audio data. When the informa- 
tion that might be rewritten in the device changes, the 
controller monitors the change and fetches data here, 
however, it is possible that the device transmits the infor- 
mation to the controller. In this case, the necessity to 
fetch the Information is obviated, whereby the traffic on 
the transmission line 1 and the load on the controller 
can be reduced and the configuration can be simplified. 
Particularly, the contents Information that might be fre- 
quently rewritten is transmitted to the controller without 
a request from the controller, thereby significantly 
reducing the traffic on the transmission Gne and the load 
on the controller. 

[0224] The status of a device is described in RAM 1 6 
in the function list 8. The controDer can thus gra6p the 
entire status of the device at a time when monitoring the 
status of the device, thereby making rt possible to 
decrease the traffic on the transmission line 1 and facil- 
itate the processing in the controller. Moreover, the 
device does not have to respond to each inquiry about 
its status. As a result, the processing of the device can 
be simplified and the load on the device can be 
reduced. 

[0225] As described above, according to the present 
embodiment, a non-rewritable area and a rewritable 
area are included in the function list in the device, 
whereby information that ceaselessly changes as weO 
as information fixed in the device can be provided to the 
controller in a simple configuration, and changing infor- 
mation can be speedily provided to the user. 
[0226] When the contents in the rewritable area 
changes, the device notifies the controller that the con- 
tents in said rewritable area change. This obviates the 
necessity for the controller to monitor the information 
about the device, and reduces the traffic on the trans- 
mission line and the tod on the controller. 
[0227] In the rewritable area in the function list in the 
device, said device stores the information about the cur- 
rently-reproducible contents, whereby information 
changing with time, especially the contents information 
to be a basis of user's operation of the equipment can 
be readily and speedily fetched. 
[0228] Furthermore, when contents reproducible by 
the device change, the device transmits to the controller 
the information about the contents that becomes newly 



reproducfcle. This obviates the necessity for the control- 
ler to monitor the contents information and fetch the 
contents Information that might frequently change. As a 
result, the load on the controller can be reduced, the 

s configuration can be slmpfflled. 

[0229] In the rewritable area in the function list in the 
device, the device stores a response to a request from 
the controller. Therefore, when there are a lot of 
responses, the device has only to write the responses in 

tp the rewritable area in the function list. That is, a job such 
as divicfing and transmitting the responses can be omit- 
ted, and therefore the load on the device can be 
reduced. 

[0230] In the rewritable area In the function list in the 
is device, the status information of the device is stored. 
This obviates the necessity for the controller to issue 
various commands to confirm the status of the device. 
Therefore, entire information about the controller can be 
fetched at a time. Consequently, the load on the control- 
so ler can be reduced, and the traffic on the transmission 
line can be decreased. 

[0231] Furthermore, a flag Indicating whether a direc- 
tory in the function Gst in the device is disposed in the 
rewritable area or non-rewritable area is provided, 

25 thereby allowing the controller to readily confirm for 
each directory whether the information might be rewrit- 
ten or not. Thus, the controller has only to check the 
information that might be rewritten, whereby the load on 
the controller can be reduced. 

30 [0232] While the still picture sequence for display and 
audio data are used in the device GUI layer, the function 
GUI layer or the sub-device GUI layer in the above 
embodiments, screen display and audio output of the 
controller may be realized by an execution code execut- 

35 able in the controller and a bytecode assuming a virtual 
machine. In this case, although constraints are added to 
the structure of the controller (a type of CPU, support for 
the virtual machine and the like), the same effect can be 
obtained. 

40 

(Others) 

[0233] In each embodiments described in the above, 
the equipment connected to the transmission line 1 han- 

45 dies at least one of video, audio or information. How- 
ever, equipment which does not directly relate to any of 
video, audio or information, for example, an air condi- 
tioner and the like may be connected to the transmis- 
sion line 1 as equipment (device) to be controlled by the 

so controller. The present Invention can be applied to a 
network control system in which such equipment is 
interconnected. 
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INDUSTRIAL APPLICABILITY 

[0234] The present invention is applied to a network 
control system for operating over a network equipment 
Interconnected on the network, more specifically to an 



24 



47 



EP 0 939 517 A1 



48 



equipment control system provtdng on a screen a 
graphical user interlace (QUI) for supporting user's 
operation of equipment by means of graphics, charac- 
ters and the like. The present invention is suitable for, for 
example, a network control system In which a plurality of 
AV equipment are interconnected by a transmission line 
such as a serial bus of the IEEE standard 1394 and 
equipment having the QUI controls other equipment 
through the transmission line. 

Claims 

1. A network control system in which a plurality of 
equipment are connected through a transmission 
line, and first equipment controls second equipment 
through said transmission line, wherein 

at least one of said first and second equipment 
handles at least one of video, audio and Infor- 
mation, 

said first equipment Includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 
controlled by said controller, 
said device has function information indicating 
functions of said device itself, and 
said controller acquires said function informa- 
tion from said device through said transmission 
line, and controls said device through said 
transmission line through the use of said func- 
tion Information according to a user's operation 
performed by means of said user interface. 

2. Second equipment, connected to first equipment 
including a controller through a transmission line, 
including a device to be controlled by said controller 
through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
wherein said device 

has function information indicating functions of 
said device, 

sends said function information to said trans- 
mission line in response to a request from said 
controller, and 

operates in accordance with control performed 
by said controller on a basis of said function 
information to realize the functions of said 
device. 

3. First equipment connected to second equipment 
through a transmission line, including a controller 
controlling a device included in said second equip- 
ment through said transmission line, 

at least one of said first and second equipment 



handling at least one of video, audio, and infor- 
mation, and 
wherein said controller 
comprises a user interface, 

5 acquires function information indicating func- 

tions of said device from said device through 
said transmission line, and 
controls said device through said transmission 
line through the use of said function information 

w according to a user's operation performed by 

means of said user interface. 

4. The network control 6ystem according to claim 1, 
wherein 

15 

said function information has a layer structure, 
and includes a device information layer com- 
posed of attribute information including identifi- 
cation Information of said device, and function 
20 information layer indicating the functions of 

said device. 

5. The network control system according to claim 1, 
wherein 

25 

said device includes a plurality of sub-devices, 
and 

said function information has a layer structure, 
and includes a device information layer corn- 
so posed of attribute information including identifi- 
cation information of said device, a sub-device 
information layer composed of attribute infor- 
mation including identification information of 
said sub-devices, and function information 
35 layer indicating the functions of said sub- 
device. 

6. The network control system according to claim 1, 
wherein said function information includes user 

40 interface information. 

7. The network control system according to claims 4 
or 5, wherein said function information includes a 
device QUI layer composed of user interlace infor- 

46 mation of fie device identified with the attribute 
information in said device information layer. 

8. The network control system according to claims 4 
or 5, wherein said function information includes a 

so function QU I layer composed of user interface infor- 
mation of the functions in said function information 
layer. 

9. The network control system according to claim 5, 
ss wherein said function information has a sub-device 

GUI layer composed of user interface information of 
sub-devices Identified with the attribute information 
in said sub-device information layer. 
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10. The network control system according to claims 4 
or 5 wherein an identifier is provided for each of the 
functions In said function Information layer. 

11. The network control system as in any one of claims 
7, 8 and 9, wherein information in said device GUI 
layer, said function QUI layer or said sub-device 
GUI layer is classified according to user's operation 
and a status of said device, 

12. The network control system according to claim 1, 
wherein 

said function information includes a control 
code corresponding to each of the functions 
which said device has, and 
when said controller transmits the control code 
included in said function information to said 
device through said transmission line, said 
device operates in accordance with said con- 
trol code to realize a fonction corresponding to 
said control code. 

1 3. The equipment according to claim 2, wherein 

said function information Includes a control 
code corresponding to each of the functions of 
said device, and 

said device sends said function information to 
said transmission line in response to the prede- 
termined request from said controller, and 
operates in accordance with the control code 
received from said controller, to realize a func- 
tion corresponding to said control coda 

14. The equipment according to claim 3, wherein said 
controller acquires said function information includ- 
ing a control code corresponding to each of the 
functions of said device from said device through 
said transmission line, and sends the control code 
in said function information to said device through 
said transmission line according to the user's oper- 
ation performed by means of said user interface, to 
control said device. 

15. The network control system according to claim 1, 
wherein 

said function information includes display data 
representing each of the functions of said 
device, and 

said controller includes display means for dis- 
playing the functions of said device through the 
use of said display data. 

1 6. The equipment according to claim 2, wherein 

said function information includes display data 



50 

representing each of the functions of said 
device, and 

said device sends said function information to 
said transmission line in response to the prede- 

5 termlned request from raid controller, and 
operates in accordance with the control per- 
formed by said controller on the basis of said 
function information, to realize the functions of 
said device, 

1 7. The equipment according to claim 3, wherein 
said controller 

comprises display means as said user Intar- 
is face, and 

acquires said function information including 
display data representing each of the functions 
of said device from said device through said 
transmission line, and displays each of the 
so functions of said device with said display 

means through the use of said display data, to 
control said device through said transmission 
line through the use of said function information 
according to the user's operation performed by 

6 means of said user interface. 

1a The network control system according to claim 15, 
wherein 

so said function information includes a control 

code corresponding to each of the display data, 
said controller displays each of the functions of 
said device with said display means through 
the use of the display data Included in said 
35 function information, and transmits the control 

code corresponding to said display data 
through said transmission line to said device 
according to the user's operation performed by 
means of said user interface for said display 
40 data, and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line, to realize a 
function indicated by said display data corre- 
45 spending to said control code. 

19l The equipment according to claim 16, wherein 

said function information includes a control 
so code corresponding to each of said display 

data, and 

said device sends said function information to 
said transmission line in response to the prede- 
termined request from said controller, and 
ss operates In accordance with the control code 

received from said controller, to realize a func- 
tion Indicated by said display data correspond- 
ing to said control code. 
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2a The equipment according to claim 17, wherein said 
controller acquires said function information includ- 
ing the display data representing each of the func- 
tions of eaid device and a control code 
corresponding to each of the display data, displays 
each of the functions of raid device through the use 
of said display data with said display means, and 
transmits the control code corresponding to said 
display data through said transmission line accord- 
ing to the user's operation performed by means of 
said user interface for said cfisplay data, to control 
said device. 

21. The network control system according to claim 11, 
wherein 

said device QUI layer, said function QUI layer, 
or said sub-device GUI layer includes display 
data for each of the classified categories, and 
6aid controller conprises display means for 
displaying the user Interlace of said device, 
said function, or said sub-device for each of the 
categories through the use of said display data. 

22. The network control system according to claim 1, 
wherein 

said function information includes audio data 
for the user interface, and 
raid controller includes aucfio reproducing 
means for reproducing audio through the use 
of said audio data. 

23. The network control system according to claim 11, 
wherein 

raid device QUI layer, raid function GUI layer, 
or said sub-device QUI layer includes audio 
data for each of the classified categories, and 
raid controller comprises audio reproducing 
means for reproducing audio as the user inter- 
face of raid device, said function, or said sub- 
device for each of the categories through the 
use of said audio data. 

24. The network control system according to claim 1, 
wherein 

raid function information includes a control 
code corresponding to each of the functions of 
raid device, 
said device comprises: 

device communication means for communicat- 
ing with said controller through raid transmis- 
sion line; and 

first control means for sending raid function 
information to said transmission Dne In 
response to a predetermined request received 



from said controller with eaid device communi- 
cation means, and making eaid device operate 
In accordance with the control code received 
from said controller with said device communi- 
c cation means, and 

raid controller comprises: 
controller communication means for communi- 
cating with said device through eaid transmis- 
sion line; and 

io second control means for acquiring said func- 

tion information from raid device by transmit- 
ting the predetermined request to said device 
with said controller communication means, and 
for controlling said device by transmitting the 

75 control code in said function information with 

said controller communication means accord- 
ing to the user's operation performed by means 
of said user interface. 

20 25. The equipment according to claim 2, wherein 



said device comprises: 

storage means containing therein raid function 
information including a control code corre- 
sponding to each of the functions of said 
device; 

communication means for communicating with 
raid controller through said transmission line; 
and 

control means for sending raid function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, and 
mating said device operate in accordance with 
the control code received from raid controller 
with said communication means. 
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26. The equipment according to claim 3, wherein 

said controller comprises: 
communication means for communicating with 
raid device through raid transmission Dne; and 
control means for acquiring from said device 
raid function information including a control 
code corresponding to each of the functions of 
said device by transmitting a predetermined 
request to said device with said communication 
means, and for controlling said device by trans- 
mitting the control code in raid function infor- 
mation with said communication means 
according to the user's operation performed by 
means of said user interface. 

27. The network control system according to daim 1, 
wherein 

said function information includes display data 
representing each of the functions of said 
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device, 

said device comprises: 

device communication means for communicat- 
ing with said controller through 6aid transmis- 
sion Dne; and s 
first control means for sending said function 
Information to said transmission fine with said 
device communication means in response to a 
predetermined request received from said con- 
troller, and making said device operate In w 
accordance with control information received 
from said controller with said device communi- 
cation means, and 
said controller comprises: 
display means for said user interface; is 
controller communication means for communi- 
cating with said device through said transmis- 
sion line; and 

second control means tor acquiring said func- 
tion information from said device by transmit- so 
ting the predetermined request to said device 
with said controller communication means, for 
displaying each of the functions of said device 
with said display means through the use of the 
display data included in said function informa- 25 
tion. and for controlling said device by transmit- 
ting the control information on the basis of said 
function information with said controller com- 
munication means according to the user's 
operation by means of said user interface. 30 

28. The equipment according to claim 2, wherein 

said device comprises: 

storage means containing therein said function as 
information including display data representing 
each of the functions of said device; 
communication means for communicating with 
said controller through said transmission fine; 
and 40 



control means for sending said function infor- 
mation to said transmission Gne in response to 
a predetermined request received from said 
controller with said communication means, and 
making said device operate in accordance with 
control information received from said control- 
ler with said communication means. 

29. The equipment according to claim 3. wherein 



to said device with said communication means, 
for displaying each of the functions of said 
device with said display means through the use 
of said display data, and for controlling said 
device by transmitting control Information on 
the basis of said function information with said 
communication means according to the user's 
operation performed by means of said user 
interface. 

30. The network control system according to claim 27, 
wherein 

said function information includes a control 
code corresponding to each of the display data, 
the first control means in said device makes 
said device operate in accordance with the 
control code received from said controller with 
said device communication means to reaDze a 
function represented by said display data cor- 
responding to said control code, and 
the second control means in said controller dis- 
plays each of the functions of said device with 
said display means through the use of the dis- 
play data included in said function information 
acquired from said device with said controller 
communication means, and transmits the con- 
trol code corresponding to said display data 
with said controDer communication means 
according to the user's operation performed by 
means of said user interlace for said display 
data. 

31. The network control system according to claim 30, 
wherein the second control means in said control- 
ler, when any one of the display data is selected by 
the user based on display provided by said display 
means, transmits the control code corresponding to 
the selected display data with said controDer com- 
munication meana 

32. The network control system according to claim 30, 
wherein said function information includes one or a 
plurality of control codes corresponding to each of 

45 the display data. 

3a The network control system according to claim 27, 
wherein 

said display data is data of a plurality of still pic- 
tures, and 

said display means in said controller sequen- 
tlaDy displays said plurality of stilt pictures 
through the use of said display data while 
switching said still pictures art a substantially 
constant time interval. 

34* The network control system according to claim 27, 



so 

said controller comprises: 
cfisplay means for said user interface; 
communication means for communicating with 
said device through said transmission line; and 
control means for acquiring from said device ss 
said function information including display data 
representing each of the functions of said 
device by transmitting a predetermined request 
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wherein 

said display data is data of a plurality of still pic- 
tures, 

said function Information includes display con- 5 
trol inforrr&tion indicating a display method of 
said plurality of still pictures, and 
said display means in said controller dsplays 
said plurality of still pictures through the use of 
said display data In accordance with said dis- w 
play control information. 

35. The equipment accortfing to daim 28, wherein 

said function information includes a control is 
code corresponding to each of the display data, 
and 

said control means makes said device operate 
in accordance with the control code received 
from said controller with said communication 20 
means, to reaOze a function represented by 
said display data corresponding to said control 
code. 

36. The equipment according to claim 29, wherein said 25 
control means acquires with said communication 
means said function information including the dis- 
play data representing each of the functions of said 
device and a control code corresponding to each of 
the display data, displays each of the functions of 30 
said device with said display means through the 
use of said display data, and transmits the control 
code corresponding to said display data with said 
communication means according to the user's 
operation performed by means of said user inter- 35 
face, for said display data, to control said device. 

37. The network control system according to claim 1, 
wherein 

40 

said function information includes audio data 
for the user interface, 
said device comprises: 

device communication means for communicat- 
ing with raid controller through said transmis- 45 
sion line; and 

first control means for sending said function 
information to said transmission line in 
response to a predetermined request received 
from said controller with said device communi- so 
cation means, and making said device operate 
in accordance with control information received 
from said controller with said device communi- 
cation means, and 

said controller comprises: ss 
audio reproducing means for reproducing 
audio from audio data; 

controller communication means for communi- 



cating with said device through said transmis- 
sion line; and 

second control means for acquiring said func- 
tion information from said device by transmit- 
ting the predetermined request to said device 
with said controller communication means, for 
reproducing audio with said audio reproducing 
means through the use of the aucfio data 
included in said function information, and for 
controlling said device by transmitting control 
information on the basis of said function infor- 
mation with said controller communication 
means according to the user's operation per- 
formed by means of said user interface. 

38. The equipment according to claim 2, wherein 

said device comprises: 

storage means containing therein said function 
information including audio data for a user 
Interface; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, and 
maid rig said device operate in accordance with 
control information received from said control- 
ler with said communication means. 

39. The equipment according to claim 3, wherein 

said controller comprises: 

audio reproducing means for reproducing 

audio from audio data; 

communication means for communicating with 
said device through said transmission fine; and 
control means for acquiring from said device 
raid function information including the audio 
data for the user interface by transmitting a pre- 
determined request to said device with said 
communication means, for reproducing aucfio 
with said audio reproducing means through the 
use of said audio data included in said function 
information, and for controlling said device by 
transmitting control Information on the basis of 
said function information with said communica- 
tion means according to the user's operation 
performed by means of said user interface. 

40. The network control system according to claim 37, 
wherein 

said function information includes the audio 
data for the user interface and reproduction 
control information indicating a reproduction 
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method of said audio (tela, and 
said audio reproducing means in said controller 
reproduces audio in accordance with said 
reproduction control information through the 
use of said audio data. 5 

41. The network control system according to claim 1, 
wherein said device, when there occurs a change in 
said function information, notifies said controller 
through said transmission line that said change io 
occurs. 

42. The equipment according to claim 2, wherein 

said device comprises: is 
storage means containing therein said function 
information; 

communication means for communicating with 
said controller through said transmission Dne; 
and so 
control means for sending said function Infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, 
notifies, when there occurs a change in said & 
function information, said controller with said 
communication means that said change 
occurs, and making said device operate in 
accordance with control information received 
from said controller with said communication so 
means. 

43. The equipment according to claim 3, wherein 

said controller comprises: ss 
communication means for communicating with 
said device through said transmission line; and 
control means for acquiring said function infor- 
mation from said device by transmitting a pre- 
determined request to said device with said *o 
communication means, and for controlling said 
device by receiving, when a notification that 
said function information changes Is transmit- 
ted from said device, said notification with said 
communication means, and transmitting con- 45 
trol information on the basis of said function 
information with said communication means 
according to the user's operation performed by 
means of 6aid user interface. 

50 

44. The network control system according to claim 1, 
wherein said device transmits, when there occurs a 
change in said function information, the changed 
information to said controller through said transmis- 
sion line. ss 

45. The equipment according to claim 2, wherein 



said device comprises: 

storage means containing therein said function 
information; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function Infor- 
mation to said transmission fine in response to 
the predetermined request received from said 
controller with said communication means, 
transmitting, when there occurs a change in 
said function information, the changed Informa- 
tion to said controller with said communication 
means, and making said device operate in 
accordance with control information received 
from said controller with said communication 
means. 

46. The equipment according to claim 3, wherein 

said controller comprises: 
communication means for communicating with 
said device through said transmission line; and 
control means for acquiring said function infor- 
mation from said device by transmitting a pre- 
determined request to said device with said 
communication means, and for controlling said 
device by receiving, when changed information 
in said function information is transmitted from 
said device, said changed information to 
update said function information, and transmit- 
ting control information on the basis of said 
function information with said communication 
means according to the user's operation per- 
formed by means of said user interface. 

47. The network control system according to claim 1 , 
wherein said device comprises storage means that 
has a non-rewritable area and rewritable area and 
contains therein said function information in said 
non-rewritable area and rewritable area. 

4& The equipment according to claim 2, wherein 

said device comprises: 

storage means that has a non-rewritable area 
and rewritable area and contains therein said 
function information in said non-rewritable area 
and rewritable area; 

communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function Infor- 
mation to said transmission line with said com- 
munication means in response to the 
predetermined request received from said con- 
troller, and making said device operate in 
accordance with control information received 
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from said controller wrth said communication 
moans. 

49. The network control 6ystem according to daim 47, 
wherein raid device notifies, when Information 
included in said function information and stored in 
said rewritable area changes, said controller that 
said information changes. 

5a The network control system according to claim 47, 
wherein said storage means in said device stores a 
response to a request from said controller In said 
rewritable area among the area where said function 
Information is stored. 

51. The network control system according to claim 47, 
wherein said storage means in said device stores 
status information of said device in said rewritable 
area among the area where said function Informa- 
tion is stored. 

52. The network control system according to claim 47, 
wherein said storage means in said device stores a 
flag indicating whether elements forming said func- 
tion information are stored in said rewritable area or 
in said non-rewritable area. 

53. The network control system according to daim 1, 
wherein said function information includes informa- 
tion indicating contents reproducible by said device. 

54. The equipment accorcOng to claim 2, wherein 

said device comprises: 

storage means containing therein said function 
information Including Information Indicating 
contents reproducfole by said device; 
communication means for communicating with 
6aid controller through said transmission line; 
and 

control means for sending said function infor- 
mation to said transmission line in response to 
the predetermined request received from said 
controller with said communication means, and 
making said device operate in accordance with 
control information received from said control- 
ler with said communication means. 

55. The equipment accord rig to claim 3, wherein 

said controller comprises: 
display means for said user interface; 
communication means for communicating with 
6aid device through said transmission line; and 
control means tor acquiring from said device 
said function information including information 
Indicating contents reproducible by said device 
by transmitting a predetermined request to said 



device with said communication means, for dis- 
playing said information indicating the contents 
with said display means, and for controlling 
raid device by transmitting control information 
8 on the basis of said function Information with 

said communication means according to the 
user's operation performed by means of said 
user lnterfac& 

w 56. The network control system according to daim 53, 
wherein said device notifies, when the contents 
reproducible by said device changes, said control- 
ler through said transmission Gne that new contents 
becomes reproducible. 

16 

57. The network control system according to daim 53, 
wherein 

said device transmits, when contents reproduc- 
ed ibie by said device change, information indicat- 
ing the contents which becomes newly 
reproducible to said controller through said 
transmission Gne. 

25 58. The network control system according to daim 53, 
wherein 

raid device comprises storage means having a 
rewritable area and containing therein said 
so function information, and 

said storage means stores in said rewritable 
area the information indicating the contents 
reproducible by said device at present. 

as Amended claims under Art. 19.1 PCT 

1. (deleted) 

2. (deleted) 

40 

3. (deleted) 

4. (amended) A network control system in which a 
plurality of equipment are connected through a 

46 transmission Gne, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
so handles at least one of video, audio and infor- 

mation, 

raid first equipment includes a controller hav- 
ing a user interface, 

said second equipment indudes a device to be 
as controlled by said controller, 

raid device has function information indicating 

functions of said device Itself, 

said controller acquires said function intorma- 
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tion from said device through said transmission 
line, and controls said device through said 
transmission line through the use of said func- 
tion information according to a user's operation 
performed by means of said user Interface, and 5 
said function information has a layer structure 
which includes a device information layer com- 
posed of attribute information including identifi- 
cation information of said device and a function 
Information layer Indicating the functions of 10 
said device. 

5. (amended) 

A network control system in which a plurality of 
equipment are connected through a transmission is 
line, and first equipment controls second equipment 
through said transmission line, wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- so 
mation, 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 
controlled by said controller, 25 
said device has a sub-device and function 
information indicating functions of said device 
itself, 

said controller acquires said function informa- 
tion from said device through said transmission so 
line, and controls said device through said 
transmission line through the use of said func- 
tion information according to a user's operation 
performed by means of said user interface, and 
said function information has a layer structure ss 
which Includes a device information layer com- 
posed of attribute information including identifi- 
cation Information of said device, a sub-device 
information layer composed of attribute infor- 
mation including identification information of *o 
said sub-device, and a function information 
layer indicating functions of said sub-device. 



6. (deleted) 



46 



7. The network control system according to claims 
4 or 5, wherein said function information includes a 
device QUI layer composed of user interface Infor- 
mation of the device identified with the attribute 
information in said device information layer. so 

8. The network control system according to claims 
4 or 5, wherein said function information includes a 
function QUI layer composed of user interface infor- 
mation of the functions In said function Information ss 
layer. 

9. The network control system according to claim 5, 



wherein said function information has a sub-device 
GUI layer composed of user interface information of 
sub-devices Identified wfth the attribute information 
in said sub-device information layer. 

10. The network control system accorting to claims 
4 or 5 wherein an identifier is provided for each of 
the functions in said function information layer. 

11. The network control system as In any one of 
claims 7, 8 and 9, wherein information in said 
device GUI layer, said function GUI layer or said 
sub-device GUI layer is classified according to 
user's operation and a status of said device. 

12. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be 
controlled by said controller, 
said device 

has function information that indicates 
functions of said device itself and includes 
user interlace information indicating each 
of the functions of said device and a con- 
trol code corresponding to each of the user 
interface Information, 

operates in accordance with the control 
code received from said controller through 
said transmission One to realize the func- 
tion indicated by said user interface infor- 
mation corresponding to said control code, 
and 

said controDer 

acquires said function information from 
said device through said transmission line, 
presents each of the functions of said 
device to a user through the use of the 
user interface information included in said 
function information, and 
transmits the control code corresponding 
to said user Interface to said device 
through said transmission line in response 
to a user's operation performed by means 
of said user interface for said user interface 
information. 
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13. (amended) Second equipment, connected to 
fiist equipment including a controller through a 
transmission line, including a device to be control- 
led by said control I er throug h said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
wherein said device 



10 



has function information that indicates 
functions of said device and includes user 
interface information indicating each of the 
functions of said device and a control code 
corresponding to each of the user interface is 
information, and 

operates In accordance with the control 
code received from said controller through 
said transmission line to realize the func- 
tion indicated by said user interface infer- 20 
mat! on corresponding to said control code. 

14. (amended) First equipment, connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device included in said 25 
second equipment through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 
mation, and 30 
wherein said controller 
comprises a user interface, and 
acquires from said device through said trans- 
mission line function information Including user 
interface information indicating each of func- ss 
Hons of said device and a control code corre- 
sponding to each of the user interlace 
Information, and controls said device by pre- 
senting to a user each of the functions of said 
device through the use of said user interface 
information, and transmitting the control code 
corresponding to said user interface informa- 
tion through said transmission line in response 
to a user's operation performed by means of 
said user Interlace for said user interface infor- 4S 
mation. 

15. (deleted) 

16. (deleted) bo 

17. (deleted) 

1 8. (amended) The network control system accord- 
ing to claim 1 2, wherein ss 

said user interface information includes display 



said controller 

has display means for said user interface, 
displays the functions of said device with 
said display means through the use of said 
display data to present said functions to 
the user, and 

transmits the control code corresponding 
to said display data to said device through 
said transmission line according to the 
user's operation performed by means of 
said user Interface for said display data, 
and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line to realize the 
function indicated by said display data corre- 
sponding to said control code. 

19. (amended) The equipment according to claim 

13, wherein 

said user interface information includes dfylay 
data, and 

raid device operates in accordance with the 
control code received from said controller 
through said transmission line to realize the 
function indicated by said display data corre- 
sponding to said control code. 

20. (amended) The equipment according to daim 

14, wherein 

said user interface information includes display 
data, and 
said controller 

has display means for said user interface, 
displays the functions of said device with 
said display means through the use of said 
display data to present said functions to 
the user, and 

transmits the control code corresponding 
to said display data to said device through 
said transmission line according to the 
user's operation performed by means of 
said user interlace for said display data to 
control said device 

21 . (amended) Hie network control system accord- 
ing to claim 1 1 , wherein 

said device GUI layer, said function QUI layer, 
or said sub-device GUI layer includes display 
data for each of the classified categories, and 
said controller comprises display means for 
displaying the user interface of said device, 
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said function, or said sub-device for each of tire 
categories through the use of said display data. 

22. (amended) A network control system in which a 
plurality of equipment are connected through a s 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment io 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment includes a device to be is 
controlled by said controller, 
said device has function information indicating 
functions of said device itself, and said function 
information includes audio data for the user 
interface, and 20 
said controller 

acquires said function information from 
said device through said transmission Gne, 
reproduces audio through the use of the ss 
audio data included In said function infor- 
mation, and 

controls said device through said transmis- 
sion line through the use of said function 
information according to a user's operation eo 
performed by means of said user interface. 

23. (amended) The network control system accord- 
ing to claim 1 1 , wherein 

35 

said device GUI layer, said function GUI layer, 
or said sub-device GUI layer includes audio 
data for each of the classified categories, and 
said controller comprises audio reproducing 
means for reproducing audio for the user inter- 40 
face of said device, said function, or said sub- 
device for each of the categories through the 
use of said audio data. 

24. (amended) A network control system in which a 45 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

BO 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user Interface, ss 
said second equipment includes a device to be 
controlled by said controller, 
said device 



has function information that indicates 
functions of said device itself and includes 
user interface Information Indicating each 
of the functions of said device and a con- 
trol code corresponding to each of the user 
interface information, and 
comprises device communication means 
for communicating with said controller 
through said transmission line, and 

first control means for sending said function 
information to said transmission line In 
response to a predetermined request received 
from said controller with said device communi- 
cation means, and making said device operate 
in accordance with the control code received 
from said controller with said device communi- 
cation means to realize the function indicated 
by said user interface corresponding to said 
control code, and 
said controller comprises 

controller communication means for com- 
municating with said device through said 
transmission line, and 
second control means for acquiring said 
function information from said device by 
transmitting the predetermined request to 
said device with said controller communi- 
cation means, for presenting to a user 
each of the functions of said dwice 
through the use of the user interface infor- 
mation included in said function informa- 
tion, and for controDlng said device by 
transmitting the control code correspond- 
ing to said user interface information with 
said controller communication means 
according to a user's operation performed 
by means of said user interface. 

25. (amended) Second equipment, connected to 
first equipment including a controDer through a 
transmission line, including a device to be control- 
led by said controller through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
wherein said device 

has function information that indicates 
functions of said device itself and includes 
user interface information indicating each 
of the functions of said device and a con- 
trol code corresponding to each of the user 
interface information, and 
comprises communication means for com- 
municating with said controller through 
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said transmission line, and 
control means for sending said function 
information to said transmission Gne in 
response to a predetermined request 
received from said controller witti said s 
communication means and making t&id 
device operate in accordance with the con- 
trol code received from said controller with 
raid communication means to realize the 
function Indicated by said user Interface io 
information corresponding to said control 
code. 

26. (amended) First equipment, connected to sec- 
ond equipment through a transmission line, inctud- ic 
ing a controller controlling a device included in said 
second equipment through said transmission line, 

at least one ol said first and second equipment 
handling at least one of video, audio, and infor- 20 
matlon, and 

wherein said controller comprises: 
a user interlace; 

communication means for communicating with 
said device through said transmission line; and 25 
control means for acquiring with said communi- 
cation means function information including 
user interface information indicating each of 
the functions of said device and a control code 
correspontfng to each of the user interface so 
Information by transmitting a predetermined 
request to said device with said communication 
means, for presenting each of the functions of 
said device to a user through the use of the 
user interface information included in said tunc- ss 
tion Information, and for controlling said device 
by transmitting the control code in said function 
information with said communication means 
according to a user's operation performed by 
means of said user interface. 40 

27. (deleted) 

28. (deleted) 

29. (deleted) 

30. (amended) The network control system accord- 
ing to claim 24, wherein 

BO 

said user interface information includes display 
data, 

said controller has display means for said user 
interface, 

the second control means In said controller dis- ss 
plays the functions of said device with said dis- 
play means through the use of the display data 
Included in said function information acquired 



from said device with said controller communi- 
cation means to present said functions to the 
user, and transmits the control code corre- 
sponding to said display data with said control- 
ler communication means according to the 
user's operation performed by means of said 
user Interface for said display data, and 
the first control means in said device makes 
raid device operate in accordance with the 
control code received from said controller with 
said device communication means to provide 
the function represented by said display data 
corresponding to said control code. 

31. The network control system according to daim 
30, wherein the second control means in said con- 
troller, when any one of the display data is selected 
by the user based on display provided by said dis- 
play means, transmits the control code correspond- 
ing to the selected display data with said controller 
communication means. 

32. The network control system according to daim 
30, wherein said function information includes one 
or a plurality of control codes corresponcfing to each 
of the display data. 

33. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user Interface, 

said second equipment includes a device to be 
controlled by said controller, 
said device comprises: 

storage means containing therein function 
information that indicates functions of said 
device itself and includes data of a plurality 
of still pictures as display data represent- 
ing functions of said device; 
device communication means for commu- 
nicating with said controller through said 
transmission line; and 
first control means for sending said func- 
tion information to said transmission line in 
response to a predetermined request 
received from said controller with said 
device communication means, and making 
said device operate in accordance with 
control Information received from said con- 
troDer with said device communication 
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means, 
said controller comprises: 

display means for said user interface; 5 
controller communication means for com- 
municating with said device through said 
transmission line; and 
second control means for acquiring said 
function Information from said device by w 
transmitting the predetermined request to 
said device with said controller communi- 
cation means, for displaying the functions 
of said device with said display means 
through the use of the display data is 
included in said function information, and 
for controlling said device by transmitting 
the control information on a basis of said 
function information with said controller 
communication means according to a so 
user's operation performed by means of 
said user interface, and 

said display means in said controller sequen- 
tially displays said plurality of still pictures 25 
through the use of said display data while 
switching the still pictures at a substantially 
constant time interval. 

34. (amended) A network control system in which a so 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

35 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface, 40 
said second equipment includes a device to be 
controlled by said controller, 
said device comprises: 

storage means containing therein function 45 
information that indicates functions of said 
device itself and includes data of a plurality 
of still pictures as display data represent- 
ing functions of said device and display 
control information indicating a display so 
means of said plurality of stiD pictures; 
device communication means for commu- 
nicating with said controller through said 
transmission line; and 

first control means for sending said tunc- ss 
tion information to said transmission line in 
response to a predetermined request 
received from said controller with said 



device communication means, and making 
said device operate in accordance with 
control information received from said con- 
troller with said device communication 
means, 

said controller comprises: 

display means for said user interlace; 
controller communication means for com- 
municating with said device through said 
transmission line; and 
second control means for acquiring said 
function information from said device by 
transmitting the predetermined request to 
said device with said controller communi- 
cation means, for displaying the functions 
of said device with said display means 
through the use of the display data 
included in said function information, and 
for controlling said device by transmitting 
the control information on the basis of said 
function information with said controller 
communication means according to a 
user's operation performed by means of 
said user interface, and 

said display means in said controller displays 
said plurality of still pictures through the use of 
said display data in accordance with said dis- 
play control information. 

35. (amended) The equipment according to claim 

25, wherein 

said user interlace information Includes display 
data, and 

said control means sends said function infor- 
mation to said transmission Gne in response to 
the predetermined request received from said 
controller with said communication means, and 
makes said device operate in accordance with 
the control code received from said controller 
with said communication means, to provide the 
function represented by said display data cor- 
responding to said control code. 

36. (amended) The equipment according to claim 

26, wherein 

said user interface information includes display 
data, 

said controller has display means for said user 
interface; and 

said control means acquires said function infor- 
mation with said communication means , and 
controls said device by displaying the functions 
of said device with said display means through 
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the use of said display data included in said 
function information to present said functions to 
the user, and transmitting the control code cor- 
responding to said display data with said com- 
munication means according to the user's s 
operation performed by means of said user 
Interface for said display data. 

37. (amended) A network control system In which a 
plurality of equipment are connected through a 10 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment is 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user Interface, 

said second equipment includes a device to be 20 
controlled by said controller, 
said device comprises: 

storage means containing therein function 
information that indicates functions of said 25 
device itself and includes audio data for the 
user interface; 

device communication means for commu- 
nicating with said controller through said 
transmission line; and bo 
first control means for sending said func- 
tion information to said transmission line in 
response to a predetermined request 
received from said controller with said 
device communication means, and making ss 
said device operate In accordance wtth 
control information received from said con- 
troller wtth said device communication 
means, and 

40 

said controller comprises: 

audio reproducing means for reproducing 
audio data; 

controller communication means for com- 46 
muni eating with said device through said 
transmission line; and 
second control means for acquiring said 
function information from 6aid device by 
transmitting the predetermined request to bo 
said device with said controller communi- 
cation means, for reproducing audio with 
said audio reproducing means through the 
use of the audio data included in said func- 
tion information, and for controlling said ss 
device by transmitting the control informa- 
tion on the basis of said function informa- 
tion with said controller communication 



means according to a user's operation per- 
formed by means of said user interface. 

38. (amended) Second equipment, connected to 
fast equipment including a controller through a 
transmission One, including a device to be control- 
led by said controller through said transmission fine, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 

wherein said device comprises: 

function information that Indicates func- 
tions of said device and includes audio 
data for a user interface; and 
communication means for communicating 
with said controller through said transmis- 
sion line; and 

control means tor sending said function 
Information to said transmission line in 
response to a predetermined request 
received from said controller with said 
communication means, and making said 
device operate in accordance with control 
information received from said controller 
with said communication means. 

39. (amended) First equipment, connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device Included in said 
second equipment through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 
mation, and 

laid controller comprises: 

a user Interface Including audio reproducing 

means; 

communication means for communicating with 
said device through said transmission Gne; and 
control means for acquiring from said device 
function information that indicates functions of 
said device and includes audio data for the 
user interface by transmitting a predetermined 
request to said device with said communication 
means, for reproducing audio with said audio 
reproducing means through the use of said 
audio data included in said function informa- 
tion, and for controlling said device by transmit- 
ting control information on the basis of said 
function information with said communication 
means according to a user's operation per- 
formed by means of said user interface 
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said function information includes the audio 
data for the user interface and reproduction 
control information indicating a reproduction 
method of said audio data, and 
said audio reproducing means in said controller 5 
reproduces said audio data in accordance with 
said reproduction control Information. 

41 . (amended) A network control system in which a 
plurality of equipment are connected through a io 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of 6aid first and second equipment w 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user Interface, 

said second equipment includes a device to be 20 
controlled by said controller, and 
said device 

has function information indicating func- 
tions of said device itself; and 25 
when there occurs a change in said func- 
tion information, notifies said controller 
through said transmission line that 6aid 
change occurs. 

30 

42. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission line, including a device to be control- 
led by said controller through said transmission line, 

35 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
said device comprises: 

storage means containing therein function 40 
information indicating functions of said device; 
and 

communication means for communicating with 
said controller through said transmission line, 
and 45 
when there occurs a change in said function 
information, notifies said controller with said 
communication means that said change 
occurs. 

so 

43. (amended) First equipment connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device Included In said 
second equipment through said transmission line, 

55 

at least one of said first and second equipment 
handling at least one of video, audio, and Infor- 
mation, and 



said controller comprises: 
a user interface; and 

communication means for communicating with 
said device through said transmission line; and 
when a notification that function information 
indicating functions of said device changes is 
transmitted from said device, receives said 
notification with said communication means. 

44. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
handles at least one of videa audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user interface, 

said second equipment Includes a device to be 
controlled by said controller, and 
said device 

has function information indicating func- 
tions of said device itself, and 
when there occurs a change in said func- 
tion information, transmits the changed 
information to said controller through said 
transmission line. 

45. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission line, including a device to be control- 
led by said controller through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
said device comprises: 

storage means containing therein function 
information indicating functions of said device; 
communication means for communicating with 
said controller through said transmission line; 
and 

when there occurs a change in said function 
information, transmits the changed information 
to said controller with said communication 
means. 

46. (amended) First equipment, connected to sec- 
ond equipment through a transmission fine, includ- 
ing a controller controlling a device included in said 
second equipment through said transmission line. 

at least one of said first and second equipment 
handling at least one of video, audio, and infor- 
mation, and 
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said controller comprises: 
a user Interface; and 

communication means for communicating with 
said device through said transmission line; and 
acquires function Information indicating tunc- 5 
lions of said device by transmitting a predeter- 
mined request to said device with raid 
communication means, and when changed 
information in said function information Is trans- 
mitted from said device, receives said changed 10 
information to update said function information 
with said communication means. 

47. (amended) A network control system In which a 
pturaGty of equipment are connected through a ie 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment so 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user Interface, 

said second equipment includes a device to be 25 
controlled by said controller, and 
said device comprises storage means that has 
a non-rewritable area and rewritable area and 
contains therein function information indicating 
functions of said device itself in 6aid non-rewn- so 
table area and rewritable area 

48. (amended) Second equipment connected to 
first equipment Including a controller through a 
transmission line, inclutfng a device to be control- ss 
led by said controller through said transmission One, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 40 
said device comprises: 

storage means that has a non-rewritable area 
and rewritable area and contains therein func- 
tion information indicating functions of said 
device In said non-rewritable area and rewrite- as 
Me area; and 

communication means for communicating with 
said controller through said transmission Una 

49. The network control system according to claim bo 
47, wherein 6aid device notifies, when information 
included in said function information and stored in 
said rewritable area changes, said controller that 
said information changes. 

55 

50. The network control system according to daim 
47, wherein said storage means In said device 
stores a response to a request from said controller 



in said rewritable area among the area where said 
function information is stored. 

51 . Ttie network control system according to daim 
47, wherein raid storage means in said device 
stores status information of said device in said 
rewritable area among the area where said function 
information is stored. 

52. The network control system according to daim 
47, wherein said storage means in said device 
stores a flag Indicating whether elements forming 
said function information are stored in said rewrita- 
ble area or in said non-rewritable area 

53. (amended) A network control system in which a 
plurality of equipment are connected through a 
transmission line, and first equipment controls sec- 
ond equipment through said transmission line, 
wherein 

at least one of said first and second equipment 
handles at least one of video, audio and infor- 
mation, 

said first equipment includes a controller hav- 
ing a user Interface, 

said second equipment includes a device to be 
controlled by said controller, 
said device has function information that indi- 
cates functions of said device itself and 
includes information indicating contents repro- 
ducible by slid device, and 
said controller acquires said function informa- 
tion from said device through transmission line, 
controls said device through said transmission 
line through the use of said function information 
according to a user's operation performed by 
means of said user interface. 

54. (amended) Second equipment, connected to 
first equipment including a controller through a 
transmission line, including a device to be control- 
led by said controller through said transmission line, 

at least one of said first and second equipment 
handling at least one of video, audio and infor- 
mation, and 
said device comprises: 

storage means containing therein said function 
information that indicates functions of said 
device and includes information indicating con- 
tents reproducible by said device; 
communication means for communicating with 
said controller through said transmission line; 
and 

control means for sending said function infor- 
mation to said transmission line in response to 
a predetermined request received from said 
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controller with said communication means, and 
making said device operate in accordance with 
control Information received from said control- 
ler with said communication means. 

5 

55. (amended) First equipment, connected to sec- 
ond equipment through a transmission line, includ- 
ing a controller controlling a device included in said 
second equipment through 6aid transmission line, 

w 

at least one of said first and second equipment 
handling at least one of video, audlcx and Infor- 
mation, and 

said controller comprises: 

is 

a user interface inclucfing display means; 
communication means for communicating 
with said device through said transmission 
One; and 

control means for acquiring from said 20 
device function information that indicates 
functions of said device and Includes infor- 
mation indicating contents reproduce by 
said device by transmitting a predeter- 
mined request to said device with said as 
communication means, for displaying said 
information indicating the contents with 
said display means, and for controlling said 
device by transmitting control Information 
on the basis of said function information so 
with said communication means according 
to a user's operation performed by means 
of said user interface. 



59. (added) The network control system according 
to claim 12, wherein 

said user interface information includes audio 
data, and 
said controller 

has aucfio reproducing means for said user 
interface, 

reproduces audio indicating the functions 
of said device with said audio reproducing 
means through the use of said audio data 
to present said functions to the user, and 
transmits the control code corresponding 
to said audio data to said device through 
said transmission line according to the 
user's operation performed by means of 
said user interface for said audio data, and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line to provide the 
function represented by said audio data corre- 
sponding to said control code. 

60. (added) The network control system according 
to claim 12, wherein said function information 
includes one or a plurality pieces of user interface 
information for each of the control codes in said 
device. 

61. (added) The equipment according to claim 13, 
wherein 



56. The network control system according to claim as 
53, wherein said device notifies, when the contents 
reproducible by said device changes, said control- 
ler through said transmission line that new contents 
becomes reproducible. 

40 

57. The network control system according to claim 
53, wherein 

said device transmits, when contents reproduc- 
ible by said device change, information Indicat- 4S 
ing the contents which becomes newly 
reproducfole to said controller through said 
transmission line. 

58. The network control system according to claim so 
53, wherein 

said device comprises storage means having a 
rewritable area and containing therein said 
function Information, and ss 
said storage means stores in said rewritable 
area the information indicating the contents 
reproducible by said device at present. 



said user interface information includes audio 
data, and 

said device operates in accordance with the 
control code received from said controller 
through said transmission line to provide the 
function represented by said audio data corre- 
sponding to said control code. 

62. (added) The equipment according to claim 13, 
wherein said function information includes one or a 
plurality pieces of user interface information for 
each of the control codes in said device. 

63. (added) The equipment according to claim 14, 
wherein 

said user interface information includes audio 
data, and 
said controller 

has audio reproducing means for said user 
interface, 

reproduces audio Indicating the functions 
of said device with said audio reproducing 
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80 



means through the use of said audio data 
to present said functions to the user, and 
transmits the control code conresponting 
to said audio data to said device through 
said transmission One according to the 0 
user's operation performed by means of 
said user interface for said audio data to 
control said device. 

64. (added) The equipment according to claim 1 4, io 
wherein said function information includes one or a 
phjraDty pieces of user Interface information for 
each of the control codes in said device. 

65. (added) The network control system according w 
to claim 24, wherein 

said user interface information includes audio 
data, and ' 

20 

said controller has audio reproducing means 
for said user interface, 

the second control means in said controller 
reproduces audio indicating the functions of 25 
said device with said audio reproducing means 
through the use of the audio data included in 
said function information acquired from said 
device with said controller communication 
means to present said functions to the user, so 
and transmits the control code corresponding 
to said audio data with said controller commu- 
nication means according to the user s opera- 
tion performed by means of said user Interface 
for said audio data, and & 



the function represented by said audio data 
corresponding to said control code. 

68. (added) The equipment according to claim 25, 
wherein said function information includes one or a 
plurality pieces of user interface information for 
each of the control codes in said device. 

69. (added) The equipment according to claim 26, 
wherein 

said user Interface information Includes audio 
data, 

said controller has audio reproducing means 
for said user interface, and 
the second control means in said controller 
controls said device by reproducing audio indi- 
cating the functions of said device with said 
audio reproducing means through the use of 
the audio data included in said function infor- 
mation acquired from said device with said 
controller communication means to present 
said functions to the user, and transmitting the 
control code corresponding to said audio data 
with said controller communication means 
according to the user's operation performed by 
means of said user interface fa said audio 
data. 

70. (amended) The equipment according to daim 
26, wherein said function information includes one 
or a plurality pieces of user interface information for 
each of the control codes in said device. 



the first control means in said device makes 
said device operate in accordance with the 
control code received from said controller with 
said device communication means to provide *o 
the function represented by said audio data 
corresponding to said control code. 



66. (added) The network control system according 
to claim 24, wherein said function information 4S 
includes one or a plurality pieces of user Interface 
information for each of the control codes in said 
device. 



67. (added) The equipment according to claim 25, so 
wherein 

said user Interface Information Includes audio 
data, and 

the first control means in said device makes 55 
said device operate in accordance with the 
control code received from said controller with 
said device communication means to provide 
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